From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 02:37:54 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8B124106566C; Sun, 18 Dec 2011 02:37:54 +0000 (UTC) (envelope-from bruce@cran.org.uk) Received: from muon.cran.org.uk (muon.cran.org.uk [IPv6:2a01:348:0:15:5d59:5c40:0:1]) by mx1.freebsd.org (Postfix) with ESMTP id 1B56E8FC12; Sun, 18 Dec 2011 02:37:54 +0000 (UTC) Received: from muon.cran.org.uk (localhost [127.0.0.1]) by muon.cran.org.uk (Postfix) with ESMTP id 223BDE6217; Sun, 18 Dec 2011 02:37:53 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=cran.org.uk; h=message-id :date:from:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; s=mail; bh=I57RAsWs1zbv so7bCeVdM/pSSpY=; b=b6xdib3FGaFnhcNsw3HKpuL4Frw9pbafcxRDLlUcF1dV LSQlIiGLb8icVSinnb31b5Y/4+uboqW3AV5yu0K+xR/EmzZqyzjNkgZn3Nypl3lh eRfxB0wmw2hfAUD/5fu8YgI9/UAqU9zBahZncIOTXnciT7/n2wvcJbPXhuEvUYA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=cran.org.uk; h=message-id :date:from:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; q=dns; s=mail; b=CKJuiw y+HKDldo71dYnwUmH4Sg61hlB5edwnD3fANdRZy6r6HaTq653wVIdL3t1LdL1zfn VWUgIvEAyYeEdSx9L/TYy7J9dmj0qSvuiXN4khsu6ZFZlIUAFnyvXXT/nyUSF+sX gTCE50iAGB2qWGMJqXKqHSnabClkPOMoFA7j4= Received: from [192.168.1.68] (188-220-36-32.zone11.bethere.co.uk [188.220.36.32]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by muon.cran.org.uk (Postfix) with ESMTPSA id CDA1BE6216; Sun, 18 Dec 2011 02:37:52 +0000 (GMT) Message-ID: <4EED5200.20302@cran.org.uk> Date: Sun, 18 Dec 2011 02:37:52 +0000 From: Bruce Cran User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Andrey Chernov , Ivan Klymenko , Doug Barton , "O. Hartmann" , Current FreeBSD , freebsd-stable@FreeBSD.ORG, freebsd-performance@FreeBSD.ORG References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> In-Reply-To: <20111213090051.GA3339@vniz.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 02:37:54 -0000 On 13/12/2011 09:00, Andrey Chernov wrote: > I observe ULE interactivity slowness even on single core machine > (Pentium 4) in very visible places, like 'ps ax' output stucks in the > middle by ~1 second. When I switch back to SHED_4BSD, all slowness is > gone. I'm also seeing problems with ULE on a dual-socket quad-core Xeon machine with 16 logical CPUs. If I run "tar xf somefile.tar" and "make -j16 buildworld" then logging into another console can take several seconds. Sometimes even the "Password:" prompt can take a couple of seconds to appear after typing my username. -- Bruce Cran From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 03:24:54 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BF82E106566C; Sun, 18 Dec 2011 03:24:54 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 550188FC08; Sun, 18 Dec 2011 03:24:54 +0000 (UTC) Received: by vbbfr13 with SMTP id fr13so5765002vbb.13 for ; Sat, 17 Dec 2011 19:24:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=x368iKnmWrkl4we0Yiv2QvjL4cvlC46YLQqOguOSAK8=; b=Yucum6xBW8R6S7XMdPOvkVpnAvyFjJcbJd7c0uN+PVSJ1S09U6wpgW68gPBZbooah9 oTappkkO8QjILClOQRnT8DLjsxzNubo+orrmyTd/5WLoYY8CVksEhSsuK4WpeyteqGHj FKgYxygGRQcXZoOglc6ZDLHbN16pTXx2Ifopg= MIME-Version: 1.0 Received: by 10.52.20.165 with SMTP id o5mr9130132vde.79.1324178693461; Sat, 17 Dec 2011 19:24:53 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.26.50 with HTTP; Sat, 17 Dec 2011 19:24:53 -0800 (PST) In-Reply-To: <4EED10EF.1030108@FreeBSD.org> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <4EECD261.2080208@m5p.com> <4EED05EC.8050103@FreeBSD.org> <4EED10EF.1030108@FreeBSD.org> Date: Sat, 17 Dec 2011 19:24:53 -0800 X-Google-Sender-Auth: By0AXkDFY2ucT3joWfCw6pX44lg Message-ID: From: Adrian Chadd To: Andriy Gapon Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: George Mitchell , freebsd-stable@freebsd.org, Oliver Pinter Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 03:24:54 -0000 On 17 December 2011 14:00, Andriy Gapon wrote: > on 17/12/2011 23:20 Adrian Chadd said the following: >> This may -not- be a userland specific problem.. > That's an interesting idea. =A0From the recent discussion about USB I can= conclude > that USB threads run at higher priority than GEOM threads: PI_NET/PI_DISK= vs > PRIBIO. =A0The former is from the ithread range, the latter is from the r= egular > kernel range. =A0Maybe it would make sense to give the GEOM threads a pri= ority > from the ithread range too - given their role and importance. Ah, so I can just punt this to you? Sweet! *punt*. I haven't had time to dig into the network side of things but I do plan on doing this soon. Hopefully something really silly shows up. Adrian From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 05:08:23 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8F0F3106566B for ; Sun, 18 Dec 2011 05:08:23 +0000 (UTC) (envelope-from paul@gromit.dlib.vt.edu) Received: from lennier.cc.vt.edu (lennier.cc.vt.edu [198.82.162.213]) by mx1.freebsd.org (Postfix) with ESMTP id 423868FC17 for ; Sun, 18 Dec 2011 05:08:23 +0000 (UTC) Received: from vivi.cc.vt.edu (vivi.cc.vt.edu [198.82.163.43]) by lennier.cc.vt.edu (8.13.8/8.13.8) with ESMTP id pBI28BXW011712; Sat, 17 Dec 2011 21:08:11 -0500 Received: from auth3.smtp.vt.edu (EHLO auth3.smtp.vt.edu) ([198.82.161.152]) by vivi.cc.vt.edu (MOS 4.3.3-GA FastPath queued) with ESMTP id TQX31769; Sat, 17 Dec 2011 21:08:11 -0500 (EST) Received: from macbook.chumby.lan (c-98-249-9-133.hsd1.va.comcast.net [98.249.9.133]) (authenticated bits=0) by auth3.smtp.vt.edu (8.13.8/8.13.8) with ESMTP id pBI28ANf020951 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sat, 17 Dec 2011 21:08:11 -0500 Mime-Version: 1.0 (Apple Message framework v1251.1) Content-Type: text/plain; charset=iso-8859-1 From: Paul Mather In-Reply-To: <4EECFD6A.2030905@xs4all.nl> Date: Sat, 17 Dec 2011 21:08:10 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> References: <4EECFD6A.2030905@xs4all.nl> To: Michiel Boland X-Mailer: Apple Mail (2.1251.1) X-Mirapoint-Received-SPF: 198.82.161.152 auth3.smtp.vt.edu paul@gromit.dlib.vt.edu 5 none X-Junkmail-Status: score=10/50, host=vivi.cc.vt.edu X-Junkmail-Signature-Raw: score=unknown, refid=str=0001.0A020208.4EED4B0B.0069,ss=1,re=0.000,fgs=0, ip=98.249.9.133, so=2011-07-25 19:15:43, dmn=2011-05-27 18:58:46, mode=single engine X-Junkmail-IWF: false Cc: freebsd-stable@freebsd.org Subject: Re: fsck_ufs out of swapspace X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 05:08:23 -0000 On Dec 17, 2011, at 3:36 PM, Michiel Boland wrote: > FreeBSD 9.0-PRERELEASE locked up while into some heavy I/O and failed = to shut down properly, so I had to power-cycle. After it came back up it = said >=20 > Starting file system checks: > ** SU+J Recovering /dev/ada0a > ** Reading 33554432 byte journal from inode 4. > swap_pager: out of swap space > swap_pager_getswapspace(16): failed > pid 67 (fsck_ufs), uid 0, was killed: out of swap space > fsck: /dev/ada0a: Killed: 9 > Script /etc/rc.d/fsck running > Unknown error; help! > ERROR: ABORTING BOOT (sending SIGTERM to parent)! >=20 > The only way to continue was to do a full fsck (with no journal) >=20 > This is a Sun Blade 100 (sparc64) with 768M of RAM. > So the fsck is taking up all of this? That can't be right. >=20 > What can I do to troubleshoot this further? FWIW, I had this happen to me several weeks ago on FreeBSD/powerpc64 = 9-CURRENT. I had to get the machine up and running so I simply = abandoned use of SU+J and went back to using just UFS+SU. (Not very = helpful, I know, but there you go.) I figure it is likely to be some = kind of endianness problem in the SU+J code, given the lack of = complaints on FreeBSD/i386 and FreeBSD/amd64. Cheers, Paul. PS: The system I was using is an Apple Xserve G5 with 4 GB of RAM and 5 = GB of swap space. As you say, surely fsck can't be using that much = memory...= From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 06:51:55 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DBF38106564A for ; Sun, 18 Dec 2011 06:51:55 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) by mx1.freebsd.org (Postfix) with ESMTP id 271DC8FC12 for ; Sun, 18 Dec 2011 06:51:54 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id pBI6plub093109; Sun, 18 Dec 2011 17:51:47 +1100 (EST) (envelope-from smithi@nimnet.asn.au) Date: Sun, 18 Dec 2011 17:51:47 +1100 (EST) From: Ian Smith To: Bruce Cran In-Reply-To: <4EED5200.20302@cran.org.uk> Message-ID: <20111218164924.L64681@sola.nimnet.asn.au> References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: Ivan Klymenko , Doug Barton , freebsd-stable@freebsd.org, "O. Hartmann" , Current FreeBSD , Andrey Chernov , freebsd-performance@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 06:51:55 -0000 On Sun, 18 Dec 2011 02:37:52 +0000, Bruce Cran wrote: > On 13/12/2011 09:00, Andrey Chernov wrote: > > I observe ULE interactivity slowness even on single core machine (Pentium > > 4) in very visible places, like 'ps ax' output stucks in the middle by ~1 > > second. When I switch back to SHED_4BSD, all slowness is gone. > > I'm also seeing problems with ULE on a dual-socket quad-core Xeon machine > with 16 logical CPUs. If I run "tar xf somefile.tar" and "make -j16 > buildworld" then logging into another console can take several seconds. > Sometimes even the "Password:" prompt can take a couple of seconds to appear > after typing my username. I'd resigned myself to expecting this sort of behaviour as 'normal' on my single core 1133MHz PIII-M. As a reproducable data point, running 'dd if=/dev/random of=/dev/null' in one konsole, specifically to heat the CPU while testing my manual fan control script, hogs it up pretty much while regularly running the script below in another konsole to check values - which often gets stuck half way, occasionally pausing _twice_ before finishing. Switching back to the first konsole (on another desktop) to kill the dd can also take a couple/few seconds. t23# cat /root/bin/t23stat #!/bin/sh echo -n "`date` " sysctl dev.cpu.0.freq dev.cpu.0.cx_usage sysctl dev.acpi_ibm | egrep 'fan_|thermal' sysctl hw.acpi.thermal.tz0.temperature acpiconf -i0 | egrep 'State|Remain|Present|Volt' Sure it's a slow machine, but it normally runs pretty smoothly. Anything with a bit of disk i/o, like buildworld, runs smooth as. This is on 8.2-R GENERIC, HZ=1000, 768MB with lots free, no swap in use. I'll definitely be trying SCHED_4BSD after updating to 8-stable unless a 'miracle cure' appears beforehand. cheers, Ian From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 07:52:50 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D1ACA106564A; Sun, 18 Dec 2011 07:52:50 +0000 (UTC) (envelope-from ache@vniz.net) Received: from vniz.net (vniz.net [194.87.13.69]) by mx1.freebsd.org (Postfix) with ESMTP id 2AF108FC17; Sun, 18 Dec 2011 07:52:45 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by vniz.net (8.14.5/8.14.5) with ESMTP id pBI7qhPc045514; Sun, 18 Dec 2011 11:52:43 +0400 (MSK) (envelope-from ache@vniz.net) Received: (from ache@localhost) by localhost (8.14.5/8.14.5/Submit) id pBI7qgIB045513; Sun, 18 Dec 2011 11:52:42 +0400 (MSK) (envelope-from ache) Date: Sun, 18 Dec 2011 11:52:42 +0400 From: Andrey Chernov To: Ian Smith Message-ID: <20111218075241.GA45367@vniz.net> Mail-Followup-To: Andrey Chernov , Ian Smith , Bruce Cran , Ivan Klymenko , Doug Barton , "O. Hartmann" , Current FreeBSD , freebsd-stable@FreeBSD.ORG, freebsd-performance@FreeBSD.ORG References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <20111218164924.L64681@sola.nimnet.asn.au> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111218164924.L64681@sola.nimnet.asn.au> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Bruce Cran , Ivan Klymenko , Doug Barton , freebsd-stable@FreeBSD.ORG, "O. Hartmann" , Current FreeBSD , freebsd-performance@FreeBSD.ORG Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 07:52:50 -0000 On Sun, Dec 18, 2011 at 05:51:47PM +1100, Ian Smith wrote: > On Sun, 18 Dec 2011 02:37:52 +0000, Bruce Cran wrote: > > On 13/12/2011 09:00, Andrey Chernov wrote: > > > I observe ULE interactivity slowness even on single core machine (Pentium > > > 4) in very visible places, like 'ps ax' output stucks in the middle by ~1 > > > second. When I switch back to SHED_4BSD, all slowness is gone. > > > > I'm also seeing problems with ULE on a dual-socket quad-core Xeon machine > > with 16 logical CPUs. If I run "tar xf somefile.tar" and "make -j16 > > buildworld" then logging into another console can take several seconds. > > Sometimes even the "Password:" prompt can take a couple of seconds to appear > > after typing my username. > > I'd resigned myself to expecting this sort of behaviour as 'normal' on > my single core 1133MHz PIII-M. As a reproducable data point, running > 'dd if=/dev/random of=/dev/null' in one konsole, specifically to heat > the CPU while testing my manual fan control script, hogs it up pretty > much while regularly running the script below in another konsole to > check values - which often gets stuck half way, occasionally pausing > _twice_ before finishing. Switching back to the first konsole (on > another desktop) to kill the dd can also take a couple/few seconds. This issue not about slow machine under load, because the same slow machine under exact the same load, but with SCHED_4BSD is very fast to response interactively. I think we should not misinterpret interactivity with speed. I see no big speed (i.e. compilation time) differences, switching schedulers, but see big _interactivity_ difference. ULE in general tends to underestimate interactive processes in favour of background ones. It perhaps helps to compilation, but looks like slowpoke OS from the interactive user experience. -- http://ache.vniz.net/ From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 10:24:01 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: by hub.freebsd.org (Postfix, from userid 1233) id 389D41065670; Sun, 18 Dec 2011 10:24:01 +0000 (UTC) Date: Sun, 18 Dec 2011 10:24:01 +0000 From: Alexander Best To: Andrey Chernov , Ian Smith , Bruce Cran , Ivan Klymenko , Doug Barton , "O. Hartmann" , Current FreeBSD , freebsd-stable@FreeBSD.ORG, freebsd-performance@FreeBSD.ORG Message-ID: <20111218102401.GA42627@freebsd.org> References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <20111218164924.L64681@sola.nimnet.asn.au> <20111218075241.GA45367@vniz.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111218075241.GA45367@vniz.net> Cc: Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 10:24:01 -0000 On Sun Dec 18 11, Andrey Chernov wrote: > On Sun, Dec 18, 2011 at 05:51:47PM +1100, Ian Smith wrote: > > On Sun, 18 Dec 2011 02:37:52 +0000, Bruce Cran wrote: > > > On 13/12/2011 09:00, Andrey Chernov wrote: > > > > I observe ULE interactivity slowness even on single core machine (Pentium > > > > 4) in very visible places, like 'ps ax' output stucks in the middle by ~1 > > > > second. When I switch back to SHED_4BSD, all slowness is gone. > > > > > > I'm also seeing problems with ULE on a dual-socket quad-core Xeon machine > > > with 16 logical CPUs. If I run "tar xf somefile.tar" and "make -j16 > > > buildworld" then logging into another console can take several seconds. > > > Sometimes even the "Password:" prompt can take a couple of seconds to appear > > > after typing my username. > > > > I'd resigned myself to expecting this sort of behaviour as 'normal' on > > my single core 1133MHz PIII-M. As a reproducable data point, running > > 'dd if=/dev/random of=/dev/null' in one konsole, specifically to heat > > the CPU while testing my manual fan control script, hogs it up pretty > > much while regularly running the script below in another konsole to > > check values - which often gets stuck half way, occasionally pausing > > _twice_ before finishing. Switching back to the first konsole (on > > another desktop) to kill the dd can also take a couple/few seconds. > > This issue not about slow machine under load, because the same > slow machine under exact the same load, but with SCHED_4BSD is very fast > to response interactively. > > I think we should not misinterpret interactivity with speed. I see no big > speed (i.e. compilation time) differences, switching schedulers, but see > big _interactivity_ difference. ULE in general tends to underestimate > interactive processes in favour of background ones. It perhaps helps to > compilation, but looks like slowpoke OS from the interactive user > experience. +1 i've also experienced issues with ULE and performed several tests to compare it to the historical 4BSD scheduler. the difference between the two does *not* seem to be speed (at least not a huge difference), but interactivity. one of the tests i performed was the following ttyv0: untar a *huge* (+10G) archive ttyv1: after ~ 30 seconds of untaring do 'ls -la $direcory', where directory contains a lot of files. i used "direcory = /var/db/portsnap", because that directory contains 23117 files on my machine. measuring 'ls -la $direcory' via time(1) revealed that SCHED_ULE takes > 15 seconds, whereas SCHED_4BSD only takes ~ 3-5 seconds. i think the issue is io. io operations usually get a high priority, because statistics have shown that - unlike computational tasks - io intensive tasks only run for a small fraction of time and then exit: read data -> change data -> writeback data. so SCHED_ULE might take these statistics too literaly and gives tasks like bsdtar(1) (in my case) too many ressources, so other tasks which require io are struggling to get some ressources assigned to them (ls(1) in my case). of course SCHED_4BSD isn't perfect, too. try using it and run the stress2 testsuite. your whole system will grind to a halt. mouse input drops below 1 HZ. even after killing all the stress2 tests, it will take a few minutes after the system becomes snappy again. cheers. alex > > -- > http://ache.vniz.net/ From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 10:26:00 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: by hub.freebsd.org (Postfix, from userid 1233) id B25331065679; Sun, 18 Dec 2011 10:26:00 +0000 (UTC) Date: Sun, 18 Dec 2011 10:26:00 +0000 From: Alexander Best To: Andrey Chernov , Ian Smith , Bruce Cran , Ivan Klymenko , Doug Barton , "O. Hartmann" , Current FreeBSD , freebsd-stable@FreeBSD.ORG, freebsd-performance@FreeBSD.ORG Message-ID: <20111218102600.GA44118@freebsd.org> References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <20111218164924.L64681@sola.nimnet.asn.au> <20111218075241.GA45367@vniz.net> <20111218102401.GA42627@freebsd.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111218102401.GA42627@freebsd.org> Cc: Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 10:26:00 -0000 On Sun Dec 18 11, Alexander Best wrote: > On Sun Dec 18 11, Andrey Chernov wrote: > > On Sun, Dec 18, 2011 at 05:51:47PM +1100, Ian Smith wrote: > > > On Sun, 18 Dec 2011 02:37:52 +0000, Bruce Cran wrote: > > > > On 13/12/2011 09:00, Andrey Chernov wrote: > > > > > I observe ULE interactivity slowness even on single core machine (Pentium > > > > > 4) in very visible places, like 'ps ax' output stucks in the middle by ~1 > > > > > second. When I switch back to SHED_4BSD, all slowness is gone. > > > > > > > > I'm also seeing problems with ULE on a dual-socket quad-core Xeon machine > > > > with 16 logical CPUs. If I run "tar xf somefile.tar" and "make -j16 > > > > buildworld" then logging into another console can take several seconds. > > > > Sometimes even the "Password:" prompt can take a couple of seconds to appear > > > > after typing my username. > > > > > > I'd resigned myself to expecting this sort of behaviour as 'normal' on > > > my single core 1133MHz PIII-M. As a reproducable data point, running > > > 'dd if=/dev/random of=/dev/null' in one konsole, specifically to heat > > > the CPU while testing my manual fan control script, hogs it up pretty > > > much while regularly running the script below in another konsole to > > > check values - which often gets stuck half way, occasionally pausing > > > _twice_ before finishing. Switching back to the first konsole (on > > > another desktop) to kill the dd can also take a couple/few seconds. > > > > This issue not about slow machine under load, because the same > > slow machine under exact the same load, but with SCHED_4BSD is very fast > > to response interactively. > > > > I think we should not misinterpret interactivity with speed. I see no big > > speed (i.e. compilation time) differences, switching schedulers, but see > > big _interactivity_ difference. ULE in general tends to underestimate > > interactive processes in favour of background ones. It perhaps helps to > > compilation, but looks like slowpoke OS from the interactive user > > experience. > > +1 > > i've also experienced issues with ULE and performed several tests to compare > it to the historical 4BSD scheduler. the difference between the two does *not* > seem to be speed (at least not a huge difference), but interactivity. > > one of the tests i performed was the following > > ttyv0: untar a *huge* (+10G) archive > ttyv1: after ~ 30 seconds of untaring do 'ls -la $direcory', where directory > contains a lot of files. i used "direcory = /var/db/portsnap", because s/portsnap/portsnap\/files/ > that directory contains 23117 files on my machine. > > measuring 'ls -la $direcory' via time(1) revealed that SCHED_ULE takes > 15 > seconds, whereas SCHED_4BSD only takes ~ 3-5 seconds. i think the issue is io. > io operations usually get a high priority, because statistics have shown that > - unlike computational tasks - io intensive tasks only run for a small fraction > of time and then exit: read data -> change data -> writeback data. > > so SCHED_ULE might take these statistics too literaly and gives tasks like > bsdtar(1) (in my case) too many ressources, so other tasks which require io are > struggling to get some ressources assigned to them (ls(1) in my case). > > of course SCHED_4BSD isn't perfect, too. try using it and run the stress2 > testsuite. your whole system will grind to a halt. mouse input drops below > 1 HZ. even after killing all the stress2 tests, it will take a few minutes > after the system becomes snappy again. > > cheers. > alex > > > > > -- > > http://ache.vniz.net/ From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 13:44:33 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EC67F106566B; Sun, 18 Dec 2011 13:44:33 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 9CD558FC08; Sun, 18 Dec 2011 13:44:33 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RcH2V-0005UK-Q5>; Sun, 18 Dec 2011 14:44:31 +0100 Received: from e178040031.adsl.alicedsl.de ([85.178.40.31] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RcH2V-0005T0-9K>; Sun, 18 Dec 2011 14:44:31 +0100 Message-ID: <4EEDEE38.10802@zedat.fu-berlin.de> Date: Sun, 18 Dec 2011 14:44:24 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Bruce Cran References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> In-Reply-To: <4EED5200.20302@cran.org.uk> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigF2AFB91AE4784E4B43C44794" X-Originating-IP: 85.178.40.31 Cc: Ivan Klymenko , Doug Barton , freebsd-stable@FreeBSD.ORG, "O. Hartmann" , Current FreeBSD , Andrey Chernov , freebsd-performance@FreeBSD.ORG Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 13:44:34 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigF2AFB91AE4784E4B43C44794 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/18/11 03:37, Bruce Cran wrote: > On 13/12/2011 09:00, Andrey Chernov wrote: >> I observe ULE interactivity slowness even on single core machine >> (Pentium 4) in very visible places, like 'ps ax' output stucks in the >> middle by ~1 second. When I switch back to SHED_4BSD, all slowness is >> gone.=20 >=20 > I'm also seeing problems with ULE on a dual-socket quad-core Xeon > machine with 16 logical CPUs. If I run "tar xf somefile.tar" and "make > -j16 buildworld" then logging into another console can take several > seconds. Sometimes even the "Password:" prompt can take a couple of > seconds to appear after typing my username. >=20 I reported ages ago several problems using SCHED_ULE on FreeBSD 8/9 when doing heavy I/O, either disk or network bound (that time I realised the problem on servers doing heavy disk I/O or net I/O). It was suspected that X could be the problem, but we also have a Dell PowerEdge 1950III running FreeBSD 8.2-STABLE (by next week 9.0-RC[2/3]/STABLE) without X, but the same problems, but no so prominent as with X. The box has 8 cores, 4 cores per socket each and 16 GB RAM, SAS 6/iR controller and two PCI-X attached Broacom NexTreme NICs, so the hardware shouldn't be any kind of trouble. But that time (over the past two years for now), the problem was considered "a personal" problem. Bah! By the beginning of next year my working group expects new hardware. Since we use for Linux for scientific work (due to OpenCL and CUDA on TESLA cards), I can't use the Blade system. The boxes I expect is one Dell Precission T7500, 96 GB RAM, two sockets, two Westmere XEONs each socket with a summary of 12 cores/24 threads. I'll start a dual OS installation with FreeBSD 10 and the most recent Suse (since the development is mostly done by my colleagues on Suse for the C2075 TESLA board, I need Suse Linux). I will then being capable of performing some benchmarks on both boxes on the very same hardware. The other box will be my desk's box, a brand new Sandy-Bridge E CPU (i7-3960X) with 32 GB RAM. I'm also inclined to install a dual boot box (I rejected this up to now since I do not like to install GRUB2 for having multiboot when using GPT on FreeBSD). The box will run with FreeBSD 9 and an Ubuntu or Gentoo Linux, if. I'm unsure in the question of Linux, but I tend to have Gentoo for compiling everything myself. On this box, I also can perform benchmarks with several setups. I see forward getting some help and/or tips to proof the issues we discussed here. Oliver --------------enigF2AFB91AE4784E4B43C44794 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO7e44AAoJEOgBcD7A/5N8JXIH/2jHjjXDyixlNuzilTAjLsCC gIG+hgdaUPpFIgNabsAEKQAyVzds3XnaxKXa6GO4LfZt0HNS0Cvi+HlAsjecVkBA 0zszqtIH69VS9HNjilTb9V3gWtOqZDjcuHAHHTjk1NguCRVhKwysH02LNi4ZABvB ZqabSecsa0aNdWPE3g8FjuItRvG32SpghXh4eYzNdgOqv5mlFbWR4Wh2QogOD5FI YNGWq95ZzAqVpvOj70RgnqRLVzWHRzGO9fEi/ePLABERKn6nJJzJImCU6R4QQU65 n5nWWtdGbTQs38ZL7K3lT4u15bpDq1pn+spkKSAldcFLjfJoNUYm0gptpSYDjxc= =xVHZ -----END PGP SIGNATURE----- --------------enigF2AFB91AE4784E4B43C44794-- From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 16:04:59 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id EBFB7106564A for ; Sun, 18 Dec 2011 16:04:59 +0000 (UTC) (envelope-from ae@FreeBSD.org) Received: from [127.0.0.1] (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 3EF32150A02; Sun, 18 Dec 2011 16:04:57 +0000 (UTC) Message-ID: <4EEE0F1A.4050609@FreeBSD.org> Date: Sun, 18 Dec 2011 20:04:42 +0400 From: "Andrey V. Elsukov" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111203 Thunderbird/8.0 MIME-Version: 1.0 To: Randy Bush References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> In-Reply-To: X-Enigmail-Version: 1.1.2 OpenPGP: id=10C8A17A Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig72190573E21E1CC653A6606C" Cc: FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 16:05:00 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig72190573E21E1CC653A6606C Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable On 17.12.2011 22:47, Randy Bush wrote: >=20 > # ATA/SCSI peripherals > device scbus # SCSI bus (required for ATA/SCSI) > #device ch # SCSI media changers > #device da # Direct Access (disks) > #device sa # Sequential Access (tape etc) > #device cd # CD > device pass # Passthrough device (direct ATA/SCSI access) > #device ses # SCSI Environmental Services (and SAF-TE) I think you should add "device da" or "device ada" option to have some disks available. --=20 WBR, Andrey V. Elsukov --------------enig72190573E21E1CC653A6606C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBAgAGBQJO7g8gAAoJEAHF6gQQyKF6UloH/RA06g/YLRVhD5+WPq/5sZY3 G5enu93XvD9oMKHXwzoHT40bQSKmLH1nOAmEejxI6GKYRBAbk7uCzXjOqskteKe8 csyahqgXgh6dJloF7eaysxMSCv5BV+FjRtYpzxZxgoEJYO0zNW9jGgVmp031kaQh grTiqn4BdFwTrTdB99sMulwAuD4mUPVW6KMgKcXws7BFvcB5+jmew0F1PhOHbSsN Biti5F5BjjPIb2Zf6AtF58M/GDC7qtBJp4YJJdFCYDJsxQbPlV6GGTyYLSX+SheP d32bgBLOHEV6Ywj1X/WYvLEWhZ/WvVt/9FGVZV/XeGSo9eG8x2VNrHuSY2guW5E= =NJFw -----END PGP SIGNATURE----- --------------enig72190573E21E1CC653A6606C-- From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 19:30:23 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3088A106566B; Sun, 18 Dec 2011 19:30:23 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 869458FC13; Sun, 18 Dec 2011 19:30:22 +0000 (UTC) Received: by vcbfk1 with SMTP id fk1so6136989vcb.13 for ; Sun, 18 Dec 2011 11:30:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=pEMdRrRcg5AdO9mTsB5TVaSe5Rr8mYJWphMeEd5LAQU=; b=fMxLrJpJs/kTvqbQG2tV/S2y1ll4h8EeAc41ApKIh6AXe1lCNazURdMyop/PEna306 WpeUWl6lohIKrYLLoi+/hM5ExM3EnmhQ8Qmq/UJrjWP6sUR3e2QSciK5F27nAbWQqQNr 1NOQvwFuP7x4jCbqHHHD3J94WljX3eEwxhl58= MIME-Version: 1.0 Received: by 10.220.230.67 with SMTP id jl3mr8014809vcb.60.1324236621811; Sun, 18 Dec 2011 11:30:21 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.26.50 with HTTP; Sun, 18 Dec 2011 11:30:21 -0800 (PST) In-Reply-To: <4EEDEE38.10802@zedat.fu-berlin.de> References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <4EEDEE38.10802@zedat.fu-berlin.de> Date: Sun, 18 Dec 2011 11:30:21 -0800 X-Google-Sender-Auth: WbSSY3HSHYssZHOU3fhvNmQzWNs Message-ID: From: Adrian Chadd To: "O. Hartmann" Content-Type: text/plain; charset=ISO-8859-1 Cc: Bruce Cran , Ivan Klymenko , Doug Barton , freebsd-stable@freebsd.org, "O. Hartmann" , Current FreeBSD , Andrey Chernov , freebsd-performance@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 19:30:23 -0000 Hi, What Attilllo and others need are KTR traces in the most stripped down example of interactive-busting workload you can find. Eg: if you're doing 32 concurrent buildworlds and trying to test interactivity - fine, but that's going to result in a lot of KTR stuff. If you can reproduce it using a dd via /dev/null and /dev/random (like another poster did) with nothing else running, then even better. If you can do it without X running, even better. I honestly suggest ignoring benchmarks for now and concentrating on interactivity. Adrian From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 21:43:14 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 688D9106564A; Sun, 18 Dec 2011 21:43:14 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id 49BDE8FC0A; Sun, 18 Dec 2011 21:43:14 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.76 (FreeBSD)) (envelope-from ) id 1RcOVl-000KJ1-Mz; Sun, 18 Dec 2011 21:43:13 +0000 Date: Sun, 18 Dec 2011 16:43:13 -0500 Message-ID: From: Randy Bush To: "Andrey V. Elsukov" In-Reply-To: <4EEE0F1A.4050609@FreeBSD.org> References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 21:43:14 -0000 >> # ATA/SCSI peripherals >> device scbus # SCSI bus (required for ATA/SCSI) >> #device ch # SCSI media changers >> #device da # Direct Access (disks) >> #device sa # Sequential Access (tape etc) >> #device cd # CD >> device pass # Passthrough device (direct ATA/SCSI access) >> #device ses # SCSI Environmental Services (and SAF-TE) > > I think you should add "device da" or "device ada" option to have some > disks available. will try. but the working 8.2 was happy with just the ata, which i have in the 9 config # ATA controllers #device ahci # AHCI-compatible SATA controllers device ata # Legacy ATA/SATA controllers options ATA_CAM # Handle legacy controllers with CAM options ATA_STATIC_ID # Static device numbering #device mvs # Marvell 88SX50XX/88SX60XX/88SX70XX/SoC SATA #device siis # SiliconImage SiI3124/SiI3132/SiI3531 SATA randy From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 21:49:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AEC93106566C for ; Sun, 18 Dec 2011 21:49:50 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta09.emeryville.ca.mail.comcast.net (qmta09.emeryville.ca.mail.comcast.net [76.96.30.96]) by mx1.freebsd.org (Postfix) with ESMTP id 92E288FC12 for ; Sun, 18 Dec 2011 21:49:50 +0000 (UTC) Received: from omta13.emeryville.ca.mail.comcast.net ([76.96.30.52]) by qmta09.emeryville.ca.mail.comcast.net with comcast id AlmR1i00617UAYkA9lpjoD; Sun, 18 Dec 2011 21:49:43 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta13.emeryville.ca.mail.comcast.net with comcast id Almz1i00N1t3BNj8Zln065; Sun, 18 Dec 2011 21:47:00 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 6BE7C102C19; Sun, 18 Dec 2011 13:49:48 -0800 (PST) Date: Sun, 18 Dec 2011 13:49:48 -0800 From: Jeremy Chadwick To: Randy Bush Message-ID: <20111218214948.GA7045@icarus.home.lan> References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "Andrey V. Elsukov" , FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 21:49:50 -0000 On Sun, Dec 18, 2011 at 04:43:13PM -0500, Randy Bush wrote: > >> # ATA/SCSI peripherals > >> device scbus # SCSI bus (required for ATA/SCSI) > >> #device ch # SCSI media changers > >> #device da # Direct Access (disks) > >> #device sa # Sequential Access (tape etc) > >> #device cd # CD > >> device pass # Passthrough device (direct ATA/SCSI access) > >> #device ses # SCSI Environmental Services (and SAF-TE) > > > > I think you should add "device da" or "device ada" option to have some > > disks available. > > will try. but the working 8.2 was happy with just the ata, which i have > in the 9 config > > # ATA controllers > #device ahci # AHCI-compatible SATA controllers > device ata # Legacy ATA/SATA controllers > options ATA_CAM # Handle legacy controllers with CAM > options ATA_STATIC_ID # Static device numbering > #device mvs # Marvell 88SX50XX/88SX60XX/88SX70XX/SoC SATA > #device siis # SiliconImage SiI3124/SiI3132/SiI3531 SATA Randy, With the introduction of FreeBSD 9.x, all ATA devices now use a translation layer (ATA->CAM), and this is especially so with anything SATA. I imagine this needs to be documented (in red, bold, etc.) in the official 9.0-RELEASE documentation, because it's probably going to trip up others. But, things of this nature are supposed to be documented in /usr/src/UPDATING, and admins are *expected* to read that file. As such, going forward, you're going to need to make sure you have SCSI support in your kernel config, including "device da" and/or "device ada" (not sure on the latter one). You'll also need to make sure any of your old rc.conf, make.conf, config files that reference ATA devices (/dev/adXX) etc. are all updated to reflect the new device naming convention. Finally, please be aware that when transitioning between FreeBSD versions, you cannot 100% reliably/safely copy your old kernel configuration file. You really do need to go through and "migrate" your kernel config to mimic what's in /sys/{arch}/conf/GENERIC. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 22:05:46 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C12151065678; Sun, 18 Dec 2011 22:05:46 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id A66718FC0A; Sun, 18 Dec 2011 22:05:46 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.76 (FreeBSD)) (envelope-from ) id 1RcOra-000KMi-EQ; Sun, 18 Dec 2011 22:05:46 +0000 Date: Sun, 18 Dec 2011 17:05:45 -0500 Message-ID: From: Randy Bush To: Jeremy Chadwick In-Reply-To: <20111218214948.GA7045@icarus.home.lan> References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> <20111218214948.GA7045@icarus.home.lan> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: "Andrey V. Elsukov" , FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 22:05:46 -0000 > With the introduction of FreeBSD 9.x, all ATA devices now use a > translation layer (ATA->CAM), and this is especially so with anything > SATA. I imagine this needs to be documented (in red, bold, etc.) in the > official 9.0-RELEASE documentation, because it's probably going to trip > up others. But, things of this nature are supposed to be documented in > /usr/src/UPDATING, and admins are *expected* to read that file. actually, even thought i am a boy, i did read UPDATING :) read again and found 20110424 > Finally, please be aware that when transitioning between FreeBSD > versions, you cannot 100% reliably/safely copy your old kernel > configuration file. i don't. i use ediff in emacs between old config and new GENERIC but my fault for missing the clue in UPDATING. thanks for the clue by four. randy From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 22:06:39 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E65D5106564A for ; Sun, 18 Dec 2011 22:06:38 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id 72C1A8FC1D for ; Sun, 18 Dec 2011 22:06:37 +0000 (UTC) Received: by wibhr1 with SMTP id hr1so1376503wib.13 for ; Sun, 18 Dec 2011 14:06:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=yaA/ESZEHug+iyU87eKYwC7oTg553tvS0fmOKKdubFM=; b=ESsIBhHCnnle1/Xw8yIhvPnXSG3fxTJrz8GmGkqRdjKFyyQVMj2gravAuLVfIL5YC0 lDI/Qm5S/RpmefmCHwBrkvYMEb5Z3fwvvEsz8Dt3oS3Avgf77ykeCikFf4QL3kVCOKjZ 2OZEw1Lsr14FF/FhmMPNiCm2ZgwBHL/KBlrcg= MIME-Version: 1.0 Received: by 10.180.82.138 with SMTP id i10mr9872462wiy.2.1324245997113; Sun, 18 Dec 2011 14:06:37 -0800 (PST) Received: by 10.223.158.129 with HTTP; Sun, 18 Dec 2011 14:06:37 -0800 (PST) In-Reply-To: <20111218214948.GA7045@icarus.home.lan> References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> <20111218214948.GA7045@icarus.home.lan> Date: Sun, 18 Dec 2011 14:06:37 -0800 Message-ID: From: Kevin Oberman To: Jeremy Chadwick Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Randy Bush , "Andrey V. Elsukov" , FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 22:06:39 -0000 On Sun, Dec 18, 2011 at 1:49 PM, Jeremy Chadwick wrote: > On Sun, Dec 18, 2011 at 04:43:13PM -0500, Randy Bush wrote: >> >> # ATA/SCSI peripherals >> >> device =A0 =A0 =A0 =A0 =A0 =A0 scbus =A0 =A0 =A0 =A0 =A0 # SCSI bus (= required for ATA/SCSI) >> >> #device =A0 =A0 =A0 =A0 =A0 =A0ch =A0 =A0 =A0 =A0 =A0 =A0 =A0# SCSI m= edia changers >> >> #device =A0 =A0 =A0 =A0 =A0 =A0da =A0 =A0 =A0 =A0 =A0 =A0 =A0# Direct= Access (disks) >> >> #device =A0 =A0 =A0 =A0 =A0 =A0sa =A0 =A0 =A0 =A0 =A0 =A0 =A0# Sequen= tial Access (tape etc) >> >> #device =A0 =A0 =A0 =A0 =A0 =A0cd =A0 =A0 =A0 =A0 =A0 =A0 =A0# CD >> >> device =A0 =A0 =A0 =A0 =A0 =A0 pass =A0 =A0 =A0 =A0 =A0 =A0# Passthro= ugh device (direct ATA/SCSI access) >> >> #device =A0 =A0 =A0 =A0 =A0 =A0ses =A0 =A0 =A0 =A0 =A0 =A0 # SCSI Env= ironmental Services (and SAF-TE) >> > >> > I think you should add "device da" or "device ada" option to have some >> > disks available. >> >> will try. =A0but the working 8.2 was happy with just the ata, which i ha= ve >> in the 9 config >> >> # ATA controllers >> #device =A0 =A0 =A0 =A0 =A0 =A0 =A0 ahci =A0 =A0 =A0 =A0 =A0 =A0# AHCI-c= ompatible SATA controllers >> device =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0ata =A0 =A0 =A0 =A0 =A0 =A0 # Lega= cy ATA/SATA controllers >> options =A0 =A0 =A0 ATA_CAM =A0 =A0 =A0 =A0 # Handle legacy controllers = with CAM >> options =A0 =A0 =A0 ATA_STATIC_ID =A0 # Static device numbering >> #device =A0 =A0 =A0 =A0 =A0 =A0 =A0 mvs =A0 =A0 =A0 =A0 =A0 =A0 # Marvel= l 88SX50XX/88SX60XX/88SX70XX/SoC SATA >> #device =A0 =A0 =A0 =A0 =A0 =A0 =A0 siis =A0 =A0 =A0 =A0 =A0 =A0# Silico= nImage SiI3124/SiI3132/SiI3531 SATA > > Randy, > > With the introduction of FreeBSD 9.x, all ATA devices now use a > translation layer (ATA->CAM), and this is especially so with anything > SATA. =A0I imagine this needs to be documented (in red, bold, etc.) in th= e > official 9.0-RELEASE documentation, because it's probably going to trip > up others. =A0But, things of this nature are supposed to be documented in > /usr/src/UPDATING, and admins are *expected* to read that file. > > As such, going forward, you're going to need to make sure you have SCSI > support in your kernel config, including "device da" and/or "device > ada" (not sure on the latter one). > > You'll also need to make sure any of your old rc.conf, make.conf, config > files that reference ATA devices (/dev/adXX) etc. are all updated to > reflect the new device naming convention. > > Finally, please be aware that when transitioning between FreeBSD > versions, you cannot 100% reliably/safely copy your old kernel > configuration file. =A0You really do need to go through and "migrate" > your kernel config to mimic what's in /sys/{arch}/conf/GENERIC. Rather than switch to the adaX names, I really, really recommend using labels. While SATA disks should be OK, there is no guarantee that either hardware or software changes won't change the ada names while labels are fixed. I would like to see better documentation on labeling file systems and disks, though. It can be rather confusing between gpart labels, glabels, and such. --=20 R. Kevin Oberman, Network Engineer E-mail: kob6558@gmail.com From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 22:09:19 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E999A1065676 for ; Sun, 18 Dec 2011 22:09:19 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id CE0678FC18 for ; Sun, 18 Dec 2011 22:09:19 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.76 (FreeBSD)) (envelope-from ) id 1RcOv1-000KNq-5T; Sun, 18 Dec 2011 22:09:19 +0000 Date: Sun, 18 Dec 2011 17:09:18 -0500 Message-ID: From: Randy Bush To: Kevin Oberman In-Reply-To: References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> <20111218214948.GA7045@icarus.home.lan> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 22:09:20 -0000 > I would like to see better documentation on labeling file systems and > disks, though. It can be rather confusing between gpart labels, > glabels, and such. been making me crazy on some systems. and i have one hpt where i used labels but the controller is soooo smart it moves dev nums under me. wanna take an axe to it but it is in dallas and who the hell wants to go there? randy From owner-freebsd-stable@FreeBSD.ORG Thu Dec 15 18:56:30 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BBD56106566C; Thu, 15 Dec 2011 18:56:30 +0000 (UTC) (envelope-from jack@jarasoft.net) Received: from orac.jarasoft.net (raats.xs4all.nl [82.95.230.43]) by mx1.freebsd.org (Postfix) with ESMTP id 670018FC08; Thu, 15 Dec 2011 18:56:29 +0000 (UTC) Received: from orac.jarasoft.net (unknown [10.10.10.10]) by orac.jarasoft.net (Postfix) with ESMTP id D75503D75D2; Thu, 15 Dec 2011 19:44:02 +0100 (CET) Received: from jarasc430 (raats.xs4all.nl [82.95.230.43]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (Client did not present a certificate) by orac.jarasoft.net (Postfix) with ESMTPSA id B9E1F3D742C; Thu, 15 Dec 2011 19:44:02 +0100 (CET) Message-ID: <57569DC83A5648F39AF0F0D1525CFA16@jarasc430> From: "Jack Raats" To: , Date: Thu, 15 Dec 2011 19:43:27 +0100 Organization: JaRaSoft, Steenbergen, Nederland MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 X-Virus-Scanned: ClamAV using ClamSMTP on orac.jarasoft.net X-Mailman-Approved-At: Sun, 18 Dec 2011 22:48:14 +0000 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: network with two gateways and one network card X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Jack Raats List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Dec 2011 18:56:30 -0000 I have a question. Perhaps soeone can point me to a solution. I have a server running FreeBSD 7.4-STABLE with one network card running = ezjail My network has two gateways. The host is running as 10.10.10.10 netmask 255.255.255.0 with gateway = 10.10.10.1 The jail must be running 192.168.178.10 netmask 255.255.255.0 with = gateway 192.168.178.1 Is this possible? How to do it?? What kind of problems to expect? Thanks for your time Jack Raats From owner-freebsd-stable@FreeBSD.ORG Fri Dec 16 18:02:10 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DA5C1106566B; Fri, 16 Dec 2011 18:02:10 +0000 (UTC) (envelope-from matthew@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id A75978FC13; Fri, 16 Dec 2011 18:02:10 +0000 (UTC) Received: from mobile-166-205-138-224.mycingular.net ([166.205.138.224] helo=www.palm.com) by phx1.phoronix.com with esmtpa (Exim 4.69) (envelope-from ) id 1RbbOg-0006dP-AI; Fri, 16 Dec 2011 11:16:39 -0600 Date: Fri, 16 Dec 2011 09:16:36 -0800 From: To: "Adrian Chadd" , "Stefan Esser" In-Reply-To: X-Mailer: Palm webOS X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Message-Id: <20111216180210.DA5C1106566B@hub.freebsd.org> X-Mailman-Approved-At: Sun, 18 Dec 2011 22:48:31 +0000 Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Joe Holden , FreeBSD Stable Mailing List , Michael Larabel , Current FreeBSD , Arnaud Lacombe , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Dec 2011 18:02:10 -0000 Thanks. My request for the person documenting the tunings also runs = the benchmark to ensure expected behaviour. The installation, execut= ion and comparison against the benchmarks in the article is fairly simple.<= br> Note that some tuning may not be relevant or recommended (ie: some o= f the fs benchmarks are sensitive to barriers and other synchronous operati= ons). I'd recommend bowing out of a benchmark with a 'we're going to = be slower since the default configuration is this way for the following rea= son' if this is the case. Thanks 'someone'. Matthew Dec 16, 2011 8:46 AM,= Adrian Chadd wrote: Can someone please write up a nice, concise blog post somewhere=0D= outlining all of this?=0D =0D Extra bonus points if it's a blog t= hat is picked up by=0D blogs.freebsdish.org and/or some of the other BSD= sites.=0D =0D Guys/girls/fuzzy things - this is 2011; people look at= shiny blog=0D sites with graphs rather than mailing lists. Sorry, we lo= st that=0D battle. :)=0D =0D =0D =0D Adrian=0D __________= _____________________________________=0D freebsd-performance@freebsd.org= mailing list=0D http://lists.freebsd.org/mailman/listinfo/freebsd-perfo= rmance=0D To unsubscribe, send any mail to "freebsd-performance-unsubscr= ibe@freebsd.org"=0D From owner-freebsd-stable@FreeBSD.ORG Sun Dec 18 10:34:41 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 652C6106564A; Sun, 18 Dec 2011 10:34:41 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 9BEF08FC13; Sun, 18 Dec 2011 10:34:40 +0000 (UTC) Received: by vcbfk1 with SMTP id fk1so5897013vcb.13 for ; Sun, 18 Dec 2011 02:34:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=s6kIoTrilkDgvCqa7CBeAusmCWmQmTPCl4RVMTG7W7o=; b=odf2/KQtLGeZG11305gEP1KiG7+ubW+oPsc0+7Eh8JLQguv73H4Ua8edlUNJ1tn3Ls hdqo8DlYC7pwZkaRQP3wBMZf+fswsbnnmZ0+DEwryKtpV3YdRC0aQLf6dR9SSXKf4uFk cVdOKApp/s6YE6A3yN8lV+o80IFCotsTmKyKA= MIME-Version: 1.0 Received: by 10.220.151.204 with SMTP id d12mr7411703vcw.40.1324204479840; Sun, 18 Dec 2011 02:34:39 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.26.50 with HTTP; Sun, 18 Dec 2011 02:34:39 -0800 (PST) In-Reply-To: <20111218102600.GA44118@freebsd.org> References: <4EE1EAFE.3070408@m5p.com> <4EE22421.9060707@gmail.com> <4EE6060D.5060201@mail.zedat.fu-berlin.de> <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost.> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <20111218164924.L64681@sola.nimnet.asn.au> <20111218075241.GA45367@vniz.net> <20111218102401.GA42627@freebsd.org> <20111218102600.GA44118@freebsd.org> Date: Sun, 18 Dec 2011 02:34:39 -0800 X-Google-Sender-Auth: uHpK_GNrw2hgPHGTKxPMp-CpkzM Message-ID: From: Adrian Chadd To: Alexander Best Content-Type: text/plain; charset=ISO-8859-1 X-Mailman-Approved-At: Sun, 18 Dec 2011 22:49:24 +0000 Cc: Bruce Cran , Ivan Klymenko , Doug Barton , Andrey Chernov , Ian Smith , "O. Hartmann" , Current FreeBSD , freebsd-stable@freebsd.org, freebsd-performance@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2011 10:34:41 -0000 The trouble is that there's lots of anecdotal evidence, but noone's really gone digging deep into _their_ example of why it's broken. The developers who know this stuff don't see anything wrong. That hints to me it may be something a little more creepy - as an example, the interplay between netisr/swi/taskqueue/callbacks and such. It may be that something is being starved that isn't obviously obvious. It's just a stab in the dark, but it sounds somewhat plausible based on what I've seen ULE do in my network throughput hacking. I applaud reppie for trying to make it as easy as possible for people to use KTR to provide scheduler traces for him to go digging with, so please, if you have these issues and you can absolutely reproduce them, please follow his instructions and work with him to get him what he needs. Adrian (wow, lots of personal pronouns packed into one sentence. It must be sleep time.) From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 01:02:57 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AEB6C106566B; Mon, 19 Dec 2011 01:02:57 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id 958968FC08; Mon, 19 Dec 2011 01:02:57 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.76 (FreeBSD)) (envelope-from ) id 1RcRd0-000LK7-0m; Mon, 19 Dec 2011 01:02:54 +0000 Date: Sun, 18 Dec 2011 20:02:53 -0500 Message-ID: From: Randy Bush To: "Andrey V. Elsukov" In-Reply-To: <4EEE0F1A.4050609@FreeBSD.org> References: <4EEC7B54.4070407@FreeBSD.org> <4EECC3E1.2000005@FreeBSD.org> <4EEE0F1A.4050609@FreeBSD.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: FreeBSD Stable Subject: Re: 8.2->9.prerel: gmirror failed with error 19 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 01:02:57 -0000 > I think you should add "device da" or "device ada" option to have some > disks available. indeed. confirmed. randy From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 08:27:25 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 91256106566C; Mon, 19 Dec 2011 08:27:25 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id 251198FC13; Mon, 19 Dec 2011 08:27:25 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2831:a229:70d2:ba0b]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPA id 099D14AC1C; Mon, 19 Dec 2011 12:27:22 +0400 (MSK) Date: Mon, 19 Dec 2011 12:27:21 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <6140271.20111219122721@serebryakov.spb.ru> To: "Samuel J. Greear" In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: quoted-printable Cc: Adrian Chadd , FreeBSD Stable Mailing List , Current FreeBSD , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lev@FreeBSD.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 08:27:25 -0000 Hello, Samuel. You wrote 15 =E4=E5=EA=E0=E1=F0=FF 2011 =E3., 16:32:47: > Other benchmarks in the Phoronix suite and their representations are > similarly flawed, _ALL_ of these results should be ignored and no time > should be wasted by any FreeBSD committer further evaluating this > garbage. (Yes, I have been down this rabbit hole). Here is one problem: we have choice from three items: (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix (communication with them, convincing, that they benchamrks are unfare / meaningless, ets) (3) Lose [potential] userbase. You know, that these benchmarks are bad. I know. But potential (and even some current!) user doesn't. And it seems, that these benchmarks become popular over Internet. --=20 // Black Lion AKA Lev Serebryakov From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 09:44:13 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 904F0106566B; Mon, 19 Dec 2011 09:44:13 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2191A8FC16; Mon, 19 Dec 2011 09:44:13 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2831:a229:70d2:ba0b]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPA id 0E0B94AC1C; Mon, 19 Dec 2011 13:44:10 +0400 (MSK) Date: Mon, 19 Dec 2011 13:44:09 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <1902268932.20111219134409@serebryakov.spb.ru> To: Adrian Chadd In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EEAE8DF.40303@rewt.org.uk> <4EEAEDE1.50604@zedat.fu-berlin.de> <4EEB42B1.1000506@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: quoted-printable Cc: Joe Holden , FreeBSD Stable Mailing List , Current FreeBSD , Arnaud Lacombe , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lev@FreeBSD.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 09:44:13 -0000 Hello, Adrian. You wrote 16 =E4=E5=EA=E0=E1=F0=FF 2011 =E3., 20:43:27: > Guys/girls/fuzzy things - this is 2011; people look at shiny blog > sites with graphs rather than mailing lists. Sorry, we lost that > battle. :) My thoughts exactly. --=20 // Black Lion AKA Lev Serebryakov From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 10:43:21 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 143A1106564A; Mon, 19 Dec 2011 10:43:21 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id B2A8A8FC14; Mon, 19 Dec 2011 10:43:20 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Rcagh-0006Da-77>; Mon, 19 Dec 2011 11:43:19 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Rcagh-0005tu-3r>; Mon, 19 Dec 2011 11:43:19 +0100 Message-ID: <4EEF1541.3020009@mail.zedat.fu-berlin.de> Date: Mon, 19 Dec 2011 11:43:13 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: lev@FreeBSD.org References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> In-Reply-To: <6140271.20111219122721@serebryakov.spb.ru> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig42E820DE89A492B418570B73" X-Originating-IP: 130.133.86.198 Cc: Adrian Chadd , FreeBSD Stable Mailing List , Current FreeBSD , "Samuel J. Greear" , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 10:43:21 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig42E820DE89A492B418570B73 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: quoted-printable On 12/19/11 09:27, Lev Serebryakov wrote: > Hello, Samuel. > You wrote 15 =E4=E5=EA=E0=E1=F0=FF 2011 =E3., 16:32:47: >=20 >> Other benchmarks in the Phoronix suite and their representations are >> similarly flawed, _ALL_ of these results should be ignored and no time= >> should be wasted by any FreeBSD committer further evaluating this >> garbage. (Yes, I have been down this rabbit hole). > Here is one problem: we have choice from three items: >=20 > (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD >=20 > (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix > (communication with them, convincing, that they benchamrks are unfare > / meaningless, ets) >=20 > (3) Lose [potential] userbase. >=20 > You know, that these benchmarks are bad. I know. But potential (and > even some current!) user doesn't. And it seems, that these benchmarks > become popular over Internet. >=20 +1 It is not about a faky way to let a specific OS look good by any means. I'M afraid of (3), which also implies pushing more towards beeing meaningless and not anymore a alternative with a unique, remarkable criteria to be choosen as __the__ operating system of the first choice for several purposes. By the way, how such a development could look alaike is very clear when it comes to GPGPU/HPC, highly related to the availability of proper graphics card drivers, X11 development and the necessary libraries, APIs and even compilers. None of those "professionals" out here, none of those pushing the eyewhitness of bad performance into very deep-insight-talks about what could cause the problem has obviously ever negotiated with people of the "upper floor" when it comes to the choice of the OS. Within my department, the *BSD aren't even considered an option, even if they would perform best for the specified purpose (which, I regeret, is a shrinking basis now since also Linux will have ZFS). Sometimes I feel like Don Quixote, fighting against windmills. Sorry having brought up this thread and I beg for pardon for putting another scrtach into the autoerotic world of the "core". --------------enig42E820DE89A492B418570B73 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iF4EAREIAAYFAk7vFUcACgkQU6Ni+wtCKv9T5QD/SOTCNVyyf6NlJowS3L0ui56j xOjYEv9qTcg9rDKxwZYA/1i6XhGlfyysh26mCTKtLsRPIA/qoBmszBE6DHj2BVnm =kznr -----END PGP SIGNATURE----- --------------enig42E820DE89A492B418570B73-- From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 11:49:19 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5A55B1065675; Mon, 19 Dec 2011 11:49:19 +0000 (UTC) (envelope-from sjg@evilcode.net) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id B249D8FC08; Mon, 19 Dec 2011 11:49:18 +0000 (UTC) Received: by qcse13 with SMTP id e13so4457735qcs.13 for ; Mon, 19 Dec 2011 03:49:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.229.106.230 with SMTP id y38mr5306405qco.83.1324295357936; Mon, 19 Dec 2011 03:49:17 -0800 (PST) Received: by 10.229.6.142 with HTTP; Mon, 19 Dec 2011 03:49:17 -0800 (PST) In-Reply-To: <6140271.20111219122721@serebryakov.spb.ru> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> Date: Mon, 19 Dec 2011 04:49:17 -0700 Message-ID: From: "Samuel J. Greear" To: lev@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Adrian Chadd , FreeBSD Stable Mailing List , Current FreeBSD , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 11:49:19 -0000 2011/12/19 Lev Serebryakov : > Hello, Samuel. > You wrote 15 =D0=B4=D0=B5=D0=BA=D0=B0=D0=B1=D1=80=D1=8F 2011 =D0=B3., 16:= 32:47: > >> Other benchmarks in the Phoronix suite and their representations are >> similarly flawed, _ALL_ of these results should be ignored and no time >> should be wasted by any FreeBSD committer further evaluating this >> garbage. (Yes, I have been down this rabbit hole). > =C2=A0Here is one problem: we have choice from three items: > > (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD > > (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix > (communication with them, convincing, that they benchamrks are unfare > / meaningless, ets) > > (3) Lose [potential] userbase. > > =C2=A0You know, that these benchmarks are bad. I know. But potential (and > =C2=A0even some current!) user doesn't. And it seems, that these benchmar= ks > =C2=A0become popular over Internet. > > -- > // Black Lion AKA Lev Serebryakov > Here is where you completely derail the train, let me paste again what I said before. ... Take the first test as an example, Blogbench read. This doesn't raise any red flags, right? At least not until you realize that Blogbench isn't a read test, it's a read/write test. So what they have done here is run a read/write test and then thrown away the write results for both platforms and reported only the read results. If you dig down into the actual results, http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will see two Blogbench numbers, one for read and another for write. These were both taken from the same Blogbench run, so FreeBSD optimizes writes over reads, that's probably a good thing for your data but a bad thing when someone totally misrepresents benchmark results. ... FreeBSD actually does _BETTER_ (subjectively) in this test than the Linux system when you look at what is really going on. FreeBSD is favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, the benchmarks need to be fixed to represent reality rather than throwing half of the results in the trash. To be quite frank, "fixing" FreeBSD to look good on this benchmark will make it a worse real-world OS. But you guys go ahead and foot-shoot over these ridiculous benchmarks all you want. Sam From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 12:14:52 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6FB45106566C for ; Mon, 19 Dec 2011 12:14:52 +0000 (UTC) (envelope-from edhoprima@gmail.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 7B3438FC16 for ; Mon, 19 Dec 2011 12:14:51 +0000 (UTC) Received: by eaaf13 with SMTP id f13so6594270eaa.13 for ; Mon, 19 Dec 2011 04:14:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type; bh=0wi/Wbuip3cH9qeu6x1992gVofK4PoRs2fI3qt+7/7w=; b=Hhw9GlA7hYve4ei9ITL5GoYQOrvx3lahn1SRvQO3RusmfZiq0mpU/ur70Z1djS3X+y T68iITu4eQp7L47Y2z16MtGnnxR+7i27PHup87WCS8KXTunlIorO0ZpaUu920U5WlLjT MO4OHxeaqleC3X8xrO74p8VxjUeolKNAPRg2U= Received: by 10.204.153.12 with SMTP id i12mr1363806bkw.134.1324296890338; Mon, 19 Dec 2011 04:14:50 -0800 (PST) MIME-Version: 1.0 Sender: edhoprima@gmail.com Received: by 10.204.99.148 with HTTP; Mon, 19 Dec 2011 04:14:29 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> From: Edho Arief Date: Mon, 19 Dec 2011 19:14:29 +0700 X-Google-Sender-Auth: f60fFL58ifrd7aLVCLxH6cjeNFk Message-ID: To: "Samuel J. Greear" Content-Type: text/plain; charset=UTF-8 Cc: Adrian Chadd , lev@freebsd.org, FreeBSD Stable Mailing List , Current FreeBSD , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 12:14:52 -0000 On Mon, Dec 19, 2011 at 6:49 PM, Samuel J. Greear wrote: > FreeBSD actually does _BETTER_ (subjectively) in this test than the > Linux system when you look at what is really going on. FreeBSD is > favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, > the benchmarks need to be fixed to represent reality rather than > throwing half of the results in the trash. To be quite frank, "fixing" > FreeBSD to look good on this benchmark will make it a worse real-world > OS. But you guys go ahead and foot-shoot over these ridiculous > benchmarks all you want. > Would you prefer a blog which allows you to: A: - create/write 100 posts/s - serve/read 1000 posts/s or B: - create/write 80 posts/s - serve/read 3000 posts/s ? I would personally choose B. -- O< ascii ribbon campaign - stop html mail - www.asciiribbon.org From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 12:43:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 90F9C1065670; Mon, 19 Dec 2011 12:43:35 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 76E908FC12; Mon, 19 Dec 2011 12:43:34 +0000 (UTC) Received: by eaaf13 with SMTP id f13so6629679eaa.13 for ; Mon, 19 Dec 2011 04:43:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=references:in-reply-to:mime-version:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=FQVOCcpkzlD7NzWddQVT3iYX1aJO/J5QVY5rRxYEaxY=; b=evT7zSp1kNTjCvTgiS9RujfehmeSMY2HcIifI0CFV8kxtBgRQVm8bcF3UQl1HhxwSU XCsVRud5+KaswrU6a2wIXHdkChfYxGEOPv36te5Bh/vA9oskmN3gtZaE7tArQYKN5W4g 2JyM6W8oJBwr9qPcHuutAiNmX3tXu7OalIFXU= Received: by 10.204.145.86 with SMTP id c22mr1307688bkv.61.1324297303797; Mon, 19 Dec 2011 04:21:43 -0800 (PST) References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> In-Reply-To: Mime-Version: 1.0 (1.0) From: Andreas Nilsson Date: Mon, 19 Dec 2011 13:21:35 +0100 Message-ID: <-4802855903238902044@unknownmsgid> To: "Samuel J. Greear" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Adrian Chadd , "lev@freebsd.org" , FreeBSD Stable Mailing List , Current FreeBSD , "freebsd-performance@freebsd.org" , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 12:43:35 -0000 On 19 dec 2011, at 12:50, "Samuel J. Greear" wrote: > 2011/12/19 Lev Serebryakov : >> Hello, Samuel. >> You wrote 15 =D0=B4=D0=B5=D0=BA=D0=B0=D0=B1=D1=80=D1=8F 2011 =D0=B3., 16= :32:47: >> >>> Other benchmarks in the Phoronix suite and their representations are >>> similarly flawed, _ALL_ of these results should be ignored and no time >>> should be wasted by any FreeBSD committer further evaluating this >>> garbage. (Yes, I have been down this rabbit hole). >> Here is one problem: we have choice from three items: >> >> (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD >> >> (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix >> (communication with them, convincing, that they benchamrks are unfare >> / meaningless, ets) >> >> (3) Lose [potential] userbase. >> >> You know, that these benchmarks are bad. I know. But potential (and >> even some current!) user doesn't. And it seems, that these benchmarks >> become popular over Internet. >> >> -- >> // Black Lion AKA Lev Serebryakov >> > > Here is where you completely derail the train, let me paste again what > I said before. > > ... > Take the first test as an example, Blogbench read. This doesn't raise > any red flags, right? At least not until you realize that Blogbench > isn't a read test, it's a read/write test. So what they have done here > is run a read/write test and then thrown away the write results for > both platforms and reported only the read results. If you dig down > into the actual results, > http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will > see two Blogbench numbers, one for read and another for write. These > were both taken from the same Blogbench run, so FreeBSD optimizes > writes over reads, that's probably a good thing for your data but a > bad thing when someone totally misrepresents benchmark results. > ... > > FreeBSD actually does _BETTER_ (subjectively) in this test than the > Linux system when you look at what is really going on. FreeBSD is > favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, > the benchmarks need to be fixed to represent reality rather than > throwing half of the results in the trash. To be quite frank, "fixing" > FreeBSD to look good on this benchmark will make it a worse real-world > OS. But you guys go ahead and foot-shoot over these ridiculous > benchmarks all you want. > > Sam > I seem to remember that before ULE people were fleeing to Linux as the os to run apache on since 4BSD didn't scale all too well. That may have changed over time though. However ULE could perhaps be made aware technologies like turbo-boost, ie with few threads higher performance might be gained by utilizing all virtual cores on a physical core before spreading tasks to too different cores. Just my speculations though :) Regards Andreas Nilsson From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 13:39:49 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5C957106566C; Mon, 19 Dec 2011 13:39:49 +0000 (UTC) (envelope-from yerenkow@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id F1F388FC0C; Mon, 19 Dec 2011 13:39:48 +0000 (UTC) Received: by ggnp1 with SMTP id p1so5855996ggn.13 for ; Mon, 19 Dec 2011 05:39:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=3lafZdW7FjQwsg/ddhWPav/+PadBzHpHigeVEwEYI50=; b=S7xgKsi5Y4gAvXSK00qaNwcVLkjUVxbQFSSrGtPSxzDWHrJVb1XQU4HtyQmEfBgy++ SVs1eb7xSV30VxDf6+TN78KtA6l75KSyzEv2BtoePCcMgWhMX7vc0iRZLp219AcdfTmI UdWfIueepxrteTZf4Dukc98KCmh0SYHDQ01A8= MIME-Version: 1.0 Received: by 10.182.112.9 with SMTP id im9mr2072693obb.74.1324300615141; Mon, 19 Dec 2011 05:16:55 -0800 (PST) Received: by 10.182.150.70 with HTTP; Mon, 19 Dec 2011 05:16:55 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> Date: Mon, 19 Dec 2011 15:16:55 +0200 Message-ID: From: Alexander Yerenkow To: Edho Arief Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 13:39:49 -0000 IMHO, no offence, as always. As were told, Phoronix used "default" setup, not tuned. So? Is average user will tune it after setup? No, he'll get same defaults, and would expect same performance as in tests, and he probably get it. The problem of FreeBSD is not it's default settings, some kind of very-safe defaults really should be there. But problem really is lacking of choosing them (defaults) during install, for average users. For example, few checkboxes with common sysctl tuning would be perfect, even if they would be marked as "Experimental", or not recommended. I'm thinking it's better way to make something in one place (like in installer) rather than require make almost same actions in many (hundreds of thousands?... more?...) places (end-users forced to read mail-lists/handbooks/forums over and over for same solutions). Simple example - many connections for PostgreSQL is not available on FreeBSD out-of-box. Just google "postgresql freebsd max connection" and you'll see how many there bikesheds requested and same solutions posted again and again :) FreeBSD currently have very obscure, closed community. To get in touch, you need to subscribe to several mail lists, constantly read them, I've just found recently (my shame of course) in mail list that there is service ( pub.allbsd.org) which constantly building current versions. This is great, but at homepage of freebsd.org there is no word about it :) I hope we all do something good about this, and things will going to change. -- Regards, Alexander Yerenkow From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 13:40:21 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 10E271065783; Mon, 19 Dec 2011 13:40:21 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id A510F8FC13; Mon, 19 Dec 2011 13:40:20 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RcdRy-0005wV-Vs>; Mon, 19 Dec 2011 14:40:19 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RcdRy-00011A-Sa>; Mon, 19 Dec 2011 14:40:18 +0100 Message-ID: <4EEF3EBD.5070804@mail.zedat.fu-berlin.de> Date: Mon, 19 Dec 2011 14:40:13 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Andreas Nilsson References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> <-4802855903238902044@unknownmsgid> In-Reply-To: <-4802855903238902044@unknownmsgid> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig29BC4489A3A49561FC71552C" X-Originating-IP: 130.133.86.198 Cc: Adrian Chadd , "lev@freebsd.org" , FreeBSD Stable Mailing List , Current FreeBSD , "Samuel J. Greear" , "freebsd-performance@freebsd.org" , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 13:40:21 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig29BC4489A3A49561FC71552C Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 12/19/11 13:21, Andreas Nilsson wrote: > On 19 dec 2011, at 12:50, "Samuel J. Greear" wrote: >=20 >> 2011/12/19 Lev Serebryakov : >>> Hello, Samuel. >>> You wrote 15 =D0=B4=D0=B5=D0=BA=D0=B0=D0=B1=D1=80=D1=8F 2011 =D0=B3.,= 16:32:47: >>> >>>> Other benchmarks in the Phoronix suite and their representations are= >>>> similarly flawed, _ALL_ of these results should be ignored and no ti= me >>>> should be wasted by any FreeBSD committer further evaluating this >>>> garbage. (Yes, I have been down this rabbit hole). >>> Here is one problem: we have choice from three items: >>> >>> (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD >>> >>> (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix >>> (communication with them, convincing, that they benchamrks are unfare= >>> / meaningless, ets) >>> >>> (3) Lose [potential] userbase. >>> >>> You know, that these benchmarks are bad. I know. But potential (and >>> even some current!) user doesn't. And it seems, that these benchmark= s >>> become popular over Internet. >>> >>> -- >>> // Black Lion AKA Lev Serebryakov >>> >> >> Here is where you completely derail the train, let me paste again what= >> I said before. >> >> ... >> Take the first test as an example, Blogbench read. This doesn't raise >> any red flags, right? At least not until you realize that Blogbench >> isn't a read test, it's a read/write test. So what they have done here= >> is run a read/write test and then thrown away the write results for >> both platforms and reported only the read results. If you dig down >> into the actual results, >> http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will >> see two Blogbench numbers, one for read and another for write. These >> were both taken from the same Blogbench run, so FreeBSD optimizes >> writes over reads, that's probably a good thing for your data but a >> bad thing when someone totally misrepresents benchmark results. >> ... >> >> FreeBSD actually does _BETTER_ (subjectively) in this test than the >> Linux system when you look at what is really going on. FreeBSD is >> favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, >> the benchmarks need to be fixed to represent reality rather than >> throwing half of the results in the trash. To be quite frank, "fixing"= >> FreeBSD to look good on this benchmark will make it a worse real-world= >> OS. But you guys go ahead and foot-shoot over these ridiculous >> benchmarks all you want. >> >> Sam >> >=20 > I seem to remember that before ULE people were fleeing to Linux as the > os to run apache on since 4BSD didn't scale all too well. That may > have changed over time though. >=20 > However ULE could perhaps be made aware technologies like turbo-boost, > ie with few threads higher performance might be gained by utilizing > all virtual cores on a physical core before spreading tasks to too > different cores. >=20 > Just my speculations though :) >=20 > Regards > Andreas Nilsson Such a scheduling stratey is definitely necessary on AMDs new "Bulldozer" architecture, which seems to be very pitty about threads locked on the same module. Microsoft just offered a patch for Windows 7 to implant such a "Bulldozer" awarenes but they withdraw the patch as invalid two days after the release. The seults seem to favour FPU performance over integer performance. As Samuel Greear wrote, FreeBSD looks not that bad in some of the benchmarks but there are obviosly issues, at least the fact that Phoronix/openbenchmark.org are the only sites offering benchmarks at all.= People outside the FreeBSD realm looking for opportunities, what do you think they will look first after? Phoronix/Openbenchmark.org made the first step and they seem to make FreeBSD look bad (in my opinion), whether righteous or not. Compared to several subjective impressions I have in our heterogeneous environment at the lab, Linux on the same hardware looks in several aspects much bett= er. Oliver --------------enig29BC4489A3A49561FC71552C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iF4EAREIAAYFAk7vPsIACgkQU6Ni+wtCKv9F6gD+L6Yl43PugtrH2aCjeNsAAURl UlEQkfMGOI2jl0hz1sAA/2kbm5jV1Gg1LCzkX4CurY8Q7fMkNnNVpONHIyW0wI3Q =a3fR -----END PGP SIGNATURE----- --------------enig29BC4489A3A49561FC71552C-- From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 17:46:05 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7C96B106564A for ; Mon, 19 Dec 2011 17:46:05 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id 2A2AA8FC13 for ; Mon, 19 Dec 2011 17:46:04 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=W+3HolAV4FdXwliTYx7lZerTTkWGdt9rZqjp/+MFX/Y=; b=dQyAOm4/XeU8Ap4UdotYsoI2lR8J56CRbU/xkvoXq65Ca9Pgzxan6WS4HYmzbZm8nd1lO6Muyq9IVtqrSFo5iyaJNZYf5Na6rMihHMgsZwP/a02OaO/KIiC0stITW4ieqOn6daZsPvFcJOeB/eAeUuTTACoFV+MXCYtZiqV35bs=; Received: from [178.137.138.140] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RchHm-0000Vi-H7 ; Mon, 19 Dec 2011 19:46:02 +0200 Date: Mon, 19 Dec 2011 19:46:01 +0200 From: Ivan Klymenko To: Andriy Gapon Message-ID: <20111219194601.6d0285c7@nonamehost.> In-Reply-To: <4EED05EC.8050103@FreeBSD.org> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <4EECD261.2080208@m5p.com> <4EED05EC.8050103@FreeBSD.org> X-Mailer: Claws Mail 3.7.10 (GTK+ 2.24.6; amd64-portbld-freebsd10.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: George Mitchell , freebsd-stable@FreeBSD.org, Oliver Pinter Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 17:46:05 -0000 =D0=92 Sat, 17 Dec 2011 23:13:16 +0200 Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > on 17/12/2011 19:33 George Mitchell said the following: > > Summing up for the record, in my original test: > > 1. It doesn't matter whether X is running or not. > > 2. The problem is not limited to two or fewer CPUs. (It also > > happens for me on a six-CPU system.) > > 3. It doesn't require nCPU + 1 compute-bound processes, just nCPU. > >=20 > > With nCPU compute-bound processes running, with SCHED_ULE, any other > > process that is interactive (which to me means frequently waiting > > for I/O) gets ABYSMAL performance -- over an order of magnitude > > worse than it gets with SCHED_4BSD under the same conditions. >=20 > I definitely do not see anything like this. > Specifically: > - with X > - with 2 CPUs > - with nCPU and/or nCPU + 1 compute-bound processes > - with SCHED_ULE obviously :-) > I do not get "abysmal" performance for I/O active tasks. >=20 > Perhaps there is something specific that you would want me to run and > measure. >=20 Well, share your experiences - what to do, what would the others were fine with SCHED_ULE. ;) From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 18:21:42 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 78B14106566C for ; Mon, 19 Dec 2011 18:21:42 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id BAED28FC0A for ; Mon, 19 Dec 2011 18:21:41 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id UAA11501; Mon, 19 Dec 2011 20:21:39 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1RchqE-000GDS-Ou; Mon, 19 Dec 2011 20:21:38 +0200 Message-ID: <4EEF80B2.1010700@FreeBSD.org> Date: Mon, 19 Dec 2011 20:21:38 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Ivan Klymenko References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <4EECD261.2080208@m5p.com> <4EED05EC.8050103@FreeBSD.org> <20111219194601.6d0285c7@nonamehost.> In-Reply-To: <20111219194601.6d0285c7@nonamehost.> X-Enigmail-Version: undefined Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: freebsd-stable@FreeBSD.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 18:21:42 -0000 on 19/12/2011 19:46 Ivan Klymenko said the following: > Ð’ Sat, 17 Dec 2011 23:13:16 +0200 > Andriy Gapon пишет: > >> on 17/12/2011 19:33 George Mitchell said the following: >>> Summing up for the record, in my original test: >>> 1. It doesn't matter whether X is running or not. >>> 2. The problem is not limited to two or fewer CPUs. (It also >>> happens for me on a six-CPU system.) >>> 3. It doesn't require nCPU + 1 compute-bound processes, just nCPU. >>> >>> With nCPU compute-bound processes running, with SCHED_ULE, any other >>> process that is interactive (which to me means frequently waiting >>> for I/O) gets ABYSMAL performance -- over an order of magnitude >>> worse than it gets with SCHED_4BSD under the same conditions. >> >> I definitely do not see anything like this. >> Specifically: >> - with X >> - with 2 CPUs >> - with nCPU and/or nCPU + 1 compute-bound processes >> - with SCHED_ULE obviously :-) >> I do not get "abysmal" performance for I/O active tasks. >> >> Perhaps there is something specific that you would want me to run and >> measure. >> > > Well, share your experiences - what to do, what would the others were > fine with SCHED_ULE. ;) I didn't have to do anything special, so I am at loss as what to share. It just works (tm) for me. Sorry. -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 21:28:22 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DA9C3106566C for ; Mon, 19 Dec 2011 21:28:22 +0000 (UTC) (envelope-from boland37@xs4all.nl) Received: from smtp-vbr5.xs4all.nl (smtp-vbr5.xs4all.nl [194.109.24.25]) by mx1.freebsd.org (Postfix) with ESMTP id 5376C8FC0A for ; Mon, 19 Dec 2011 21:28:22 +0000 (UTC) Received: from charlemagne.boland.org (59-36-215.ftth.xms.internl.net [82.215.36.59]) (authenticated bits=0) by smtp-vbr5.xs4all.nl (8.13.8/8.13.8) with ESMTP id pBJLRosj095573 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NO); Mon, 19 Dec 2011 22:27:50 +0100 (CET) (envelope-from boland37@xs4all.nl) Message-ID: <4EEFAC55.6050507@xs4all.nl> Date: Mon, 19 Dec 2011 22:27:49 +0100 From: Michiel Boland User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.24) Gecko/20111110 Thunderbird/3.1.16 MIME-Version: 1.0 To: Paul Mather References: <4EECFD6A.2030905@xs4all.nl> <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> In-Reply-To: <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by XS4ALL Virus Scanner Cc: freebsd-stable@freebsd.org Subject: Re: fsck_ufs out of swapspace X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 21:28:22 -0000 Problem solved - it was indeed an endian thing. The problem is that fsck uses a real_dev_bsize variable that is declared long, but the DIOCGSECTORSIZE ioctl takes an u_int argument. A PR has been submitted. Cheers Michiel From owner-freebsd-stable@FreeBSD.ORG Mon Dec 19 21:33:45 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: by hub.freebsd.org (Postfix, from userid 1233) id 6B4AF106566B; Mon, 19 Dec 2011 21:33:45 +0000 (UTC) Date: Mon, 19 Dec 2011 21:33:45 +0000 From: Alexander Best To: Nathan Whitehorn Message-ID: <20111219213345.GA64578@freebsd.org> References: <4EE69C5A.3090005@FreeBSD.org> <20111213104048.40f3e3de@nonamehost> <20111213090051.GA3339@vniz.net> <4EED5200.20302@cran.org.uk> <20111218164924.L64681@sola.nimnet.asn.au> <20111218075241.GA45367@vniz.net> <20111218102401.GA42627@freebsd.org> <20111218102600.GA44118@freebsd.org> <4EEF5CC1.7020709@freebsd.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EEF5CC1.7020709@freebsd.org> X-Mailman-Approved-At: Mon, 19 Dec 2011 21:51:44 +0000 Cc: Bruce Cran , Ivan Klymenko , Adrian Chadd , Doug Barton , freebsd-stable@freebsd.org, Ian Smith , "O. Hartmann" , Current FreeBSD , freebsd-performance@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2011 21:33:45 -0000 On Mon Dec 19 11, Nathan Whitehorn wrote: > On 12/18/11 04:34, Adrian Chadd wrote: > >The trouble is that there's lots of anecdotal evidence, but noone's > >really gone digging deep into _their_ example of why it's broken. The > >developers who know this stuff don't see anything wrong. That hints to > >me it may be something a little more creepy - as an example, the > >interplay between netisr/swi/taskqueue/callbacks and such. It may be > >that something is being starved that isn't obviously obvious. It's > >just a stab in the dark, but it sounds somewhat plausible based on > >what I've seen ULE do in my network throughput hacking. > > > >I applaud reppie for trying to make it as easy as possible for people > >to use KTR to provide scheduler traces for him to go digging with, so > >please, if you have these issues and you can absolutely reproduce > >them, please follow his instructions and work with him to get him what > >he needs. > > The thing I've seen is that ULE is substantially more enthusiastic about > migrating processes between cores than 4BSD. Often, this is a good > thing, but can increase the rate of cache misses, hurting performance > for cache-bound processes (I see this particularly in HPC-type > scientific workloads). It might be interesting to add some kind of > tunable here. does r228718 have any impact regarding this behaviour? cheers. alex > > Another more interesting and slightly longer-term possibility if someone > wants a project would be to integrate scheduling decisions with hwpmc > counters, to accumulate statistics on cache hits at each context switch > and preferentially keep processes with a high hits/misses ratio on the > same thread/cache domain relative to processes with a low one. > -Nathan > > P.S. The other thing that could be very interesting from a research and > scheduling standpoint would be to integrate heterogeneous SMP support > into the operating system, with a FreeBSD-4 "Application Processor" > syscall model. We seem to be going down the road where GPGPU computing > has MMUs, timer interrupts, IPIs, etc. (the next AMD Fusions, IBM Cell). > This is something that no operating system currently supports well, and > would be a place for BSD to shine. If anyone has a free graduate student... From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 00:57:57 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BF2A6106566C for ; Tue, 20 Dec 2011 00:57:57 +0000 (UTC) (envelope-from peterjeremy@acm.org) Received: from fallbackmx07.syd.optusnet.com.au (fallbackmx07.syd.optusnet.com.au [211.29.132.9]) by mx1.freebsd.org (Postfix) with ESMTP id 33E8A8FC13 for ; Tue, 20 Dec 2011 00:57:56 +0000 (UTC) Received: from mail36.syd.optusnet.com.au (mail36.syd.optusnet.com.au [211.29.133.76]) by fallbackmx07.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id pBJMpmuJ018497 for ; Tue, 20 Dec 2011 09:51:48 +1100 Received: from server.vk2pj.dyndns.org (c220-239-116-103.belrs4.nsw.optusnet.com.au [220.239.116.103]) by mail36.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id pBJMpjqd026921 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 20 Dec 2011 09:51:45 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.5/8.14.4) with ESMTP id pBJMpir6002543; Tue, 20 Dec 2011 09:51:44 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.5/8.14.4/Submit) id pBJMphvp002542; Tue, 20 Dec 2011 09:51:43 +1100 (EST) (envelope-from peter) Date: Tue, 20 Dec 2011 09:51:43 +1100 From: Peter Jeremy To: Michiel Boland Message-ID: <20111219225143.GD2391@server.vk2pj.dyndns.org> References: <4EECFD6A.2030905@xs4all.nl> <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> <4EEFAC55.6050507@xs4all.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="w7PDEPdKQumQfZlR" Content-Disposition: inline In-Reply-To: <4EEFAC55.6050507@xs4all.nl> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: fsck_ufs out of swapspace X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 00:57:57 -0000 --w7PDEPdKQumQfZlR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2011-Dec-19 22:27:49 +0100, Michiel Boland wrote: >Problem solved - it was indeed an endian thing. >The problem is that fsck uses a real_dev_bsize variable that is declared l= ong,=20 >but the DIOCGSECTORSIZE ioctl takes an u_int argument. To be accurate, this isn't an endian problem, it's a general problem of passing a pointer to an incorrectly sized object. The bug is masked on amd64 & iA64 because real_dev_bsize is statically allocated and therefore initialised to zero. This means the failure to assign the top 32 bits in the ioctl doesn't affect the final result. >A PR has been submitted. sparc64/163460 for the record. Thank you for tracking that down. --=20 Peter Jeremy --w7PDEPdKQumQfZlR Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk7vv/8ACgkQ/opHv/APuIcaJgCePunwxB4xMLMy7nq7FctnaBdt t18AoJVcekBR/Kb4d023spEGYUqV6joL =TzXh -----END PGP SIGNATURE----- --w7PDEPdKQumQfZlR-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 08:25:45 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 799FC106564A for ; Tue, 20 Dec 2011 08:25:45 +0000 (UTC) (envelope-from ganael.laplanche@martymac.org) Received: from data.galacsys.net (webmail.galacsys.net [217.24.81.215]) by mx1.freebsd.org (Postfix) with ESMTP id 156BB8FC0C for ; Tue, 20 Dec 2011 08:25:44 +0000 (UTC) Received: from martymac.org (webmail.galacsys.net [217.24.81.215]) by data.galacsys.net (Postfix) with ESMTP id D484B171372 for ; Tue, 20 Dec 2011 09:08:18 +0100 (CET) From: "Ganael LAPLANCHE" To: freebsd-stable@FreeBSD.org X-Openwebmail-Date: Tue, 20 Dec 2011 10:08:18 +0200 Message-Id: <20111220080437.M63044@martymac.org> X-Mailer: Open WebMail 2.01 20030425 X-OriginatingIP: 157.99.64.43 (ganael.laplanche@martymac.org) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Date: Tue, 20 Dec 2011 09:08:18 +0100 (CET) Cc: Subject: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 08:25:45 -0000 Hi folks, I am trying to use mmap(2) with a hint address. Unfortunately, this address seems to be ignored and I never manage to get the desired one, while it seems to be free. Here is my code (the same code on NetBSD and GNU/Linux returns the hint address) : 8< ----------- >8 #include #include #include /* mmap */ #include /* getpagesize */ #include /* round_page */ #include int main(void) { size_t map_size = getpagesize(); /* first call, ask for one page, with hint */ char *map_hint = (char*)round_page(512*1024*1024); printf("=> calling mmap with hint = %p, size = %zu\n", map_hint, map_size); void *addr = mmap(map_hint, map_size, PROT_READ | PROT_WRITE | PROT_EXEC, MAP_ANON | MAP_PRIVATE, -1, 0); if (addr == MAP_FAILED) { printf("mmap failed: %s\n", strerror(errno)); } else { printf("mmap succeeded: addr = %p\n", addr); #ifdef SLEEP /* leave time to use 'procstat -v' */ sleep(10); #endif if(munmap(addr, map_size) != 0) { printf("munmap failed: %s\n", strerror(errno)); } } /* second call, one page, without hint */ map_hint = 0; printf("=> calling mmap without hint, size = %zu\n", map_size); addr = mmap(map_hint, map_size, PROT_READ | PROT_WRITE | PROT_EXEC, MAP_ANON | MAP_PRIVATE, -1, 0); if (addr == MAP_FAILED) { printf("mmap failed: %s\n", strerror(errno)); } else { printf("mmap succeeded: addr = %p\n", addr); #ifdef SLEEP /* leave time to use 'procstat -v' */ sleep(10); #endif if(munmap(addr, map_size) != 0) { printf("munmap failed: %s\n", strerror(errno)); } } return (0); } 8< ----------- >8 and its output : 1) On an i386 machine, FreeBSD 8.2-RELEASE : $ ./test-mmap => calling mmap with hint = 0x20000000, size = 4096 mmap succeeded: addr = 0x281a8000 => calling mmap without hint, size = 4096 mmap succeeded: addr = 0x281a8000 $ procstat -v 1685 PID START END PRT RES PRES REF SHD FL TP PATH 1685 0x8048000 0x8049000 r-x 1 0 1 0 CN vn /tmp/test-mmap 1685 0x8049000 0x8100000 rw- 1 0 1 0 -- df 1685 0x28049000 0x28078000 r-x 47 0 82 41 CN vn /libexec/ld-elf.so.1 1685 0x28078000 0x2807a000 rw- 2 0 1 0 C- vn /libexec/ld-elf.so.1 1685 0x2807a000 0x2808d000 rw- 12 0 1 0 -- df 1685 0x2808d000 0x2818b000 r-x 134 0 82 41 CN vn /lib/libc.so.7 1685 0x2818b000 0x28191000 rw- 6 0 1 0 C- vn /lib/libc.so.7 1685 0x28191000 0x281a8000 rw- 5 0 1 0 -- df 1685 0x281a8000 0x281a9000 rwx 0 0 0 0 -- -- 1685 0x28200000 0x28300000 rw- 2 0 1 0 -- df 1685 0xbfbe0000 0xbfc00000 rwx 3 0 1 0 -- df 2) On an amd64 machine, FreeBSD 8.2-RELEASE : $ ./test-mmap => calling mmap with hint = 0x20000000, size = 4096 mmap succeeded: addr = 0x800538000 => calling mmap without hint, size = 4096 mmap succeeded: addr = 0x800538000 $ procstat -v 38899 PID START END PRT RES PRES REF SHD FL TP PATH 38899 0x400000 0x401000 r-x 1 0 1 0 CN vn /tmp/test-mmap 38899 0x500000 0x600000 rw- 2 0 1 0 -- df 38899 0x800500000 0x800530000 r-x 48 0 218 95 CN vn /libexec/ld-elf.so.1 38899 0x800530000 0x800538000 rw- 7 0 2 0 -- df 38899 0x800538000 0x800539000 rwx 0 0 2 0 -- df 38899 0x80062f000 0x800637000 rw- 8 0 1 0 C- vn /libexec/ld-elf.so.1 38899 0x800637000 0x800646000 rw- 5 0 1 0 -- df 38899 0x800646000 0x80074e000 r-x 146 0 218 95 CN vn /lib/libc.so.7 38899 0x80074e000 0x80084e000 --- 0 0 2 0 -- df 38899 0x80084e000 0x80086d000 rw- 31 0 1 0 C- vn /lib/libc.so.7 38899 0x80086d000 0x800888000 rw- 6 0 2 0 -- df 38899 0x800a00000 0x800c00000 rw- 5 0 1 0 -- df 38899 0x7ffffffe0000 0x800000000000 rwx 3 0 1 0 -- df Using MAP_FIXED, I can get the desired address, but it is overkill (it replaces any previous mappings and its use is discouraged, see mmap(2)) and should not be needed here. Am I doing something wrong here ? -- Ganael LAPLANCHE http://www.martymac.org | http://contribs.martymac.org FreeBSD: martymac , http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 09:32:19 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 71516106566C; Tue, 20 Dec 2011 09:32:19 +0000 (UTC) (envelope-from christer.solskogen@gmail.com) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id 941FA8FC13; Tue, 20 Dec 2011 09:32:18 +0000 (UTC) Received: by wibhr1 with SMTP id hr1so2567919wib.13 for ; Tue, 20 Dec 2011 01:32:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=yuWdyf7Fw56Lo6gbnvRnGyn2QVHW7uYejRRUOH85lzY=; b=LUraSKFBVdU3/BgtIgOqc2qBE0ooMQUByClekkZAy/QLElhNiJFqfL0kmYi0hZvgSA Xs3/xZrj/6qZwsJtmKCzDt7JoOIA1IIJUHOXKIZrCGsGbiy/Ft+O/ZsFMpNaBfRKeZLU y2qlpPSin5+RJcg6oROYFqj1ro8ocKV5f6pSE= Received: by 10.180.19.138 with SMTP id f10mr3389515wie.3.1324371697282; Tue, 20 Dec 2011 01:01:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.227.57.82 with HTTP; Tue, 20 Dec 2011 01:01:16 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> From: Christer Solskogen Date: Tue, 20 Dec 2011 10:01:16 +0100 Message-ID: To: Alexander Yerenkow Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD Stable Mailing List , freebsd-performance@freebsd.org, Current FreeBSD , Edho Arief Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 09:32:19 -0000 On Mon, Dec 19, 2011 at 2:16 PM, Alexander Yerenkow wrote: > FreeBSD currently have very obscure, closed community. To get in touch, you > need to subscribe to several mail lists, constantly read them, I've just > found recently (my shame of course) in mail list that there is service ( > pub.allbsd.org) which constantly building current versions. This is great, > but at homepage of freebsd.org there is no word about it :) That's because it's not official. Do you take the risk? Would a multi-milion-dollar company do that? For your private server, sure it's probably fine. But how do you know that those files are not contaminated? (That being said, the purpose of that service is good. And the files there a most probably 100% fine. But if it's not official... then..) -- chs, if there is only one candiate, there is one one choice! From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 09:49:08 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 75A5E106567C; Tue, 20 Dec 2011 09:49:08 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id EBA1D8FC14; Tue, 20 Dec 2011 09:49:07 +0000 (UTC) Received: from alf.home (alf.kiev.zoral.com.ua [10.1.1.177]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id pBK9mXtJ033880 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 20 Dec 2011 11:48:33 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from alf.home (kostik@localhost [127.0.0.1]) by alf.home (8.14.5/8.14.5) with ESMTP id pBK9mXTg071913; Tue, 20 Dec 2011 11:48:33 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by alf.home (8.14.5/8.14.5/Submit) id pBK9mXe0071912; Tue, 20 Dec 2011 11:48:33 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: alf.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 20 Dec 2011 11:48:33 +0200 From: Kostik Belousov To: Peter Jeremy , pho@freebsd.org Message-ID: <20111220094832.GL50300@deviant.kiev.zoral.com.ua> References: <4EECFD6A.2030905@xs4all.nl> <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> <4EEFAC55.6050507@xs4all.nl> <20111219225143.GD2391@server.vk2pj.dyndns.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="e5cjMM5jrdcddfcl" Content-Disposition: inline In-Reply-To: <20111219225143.GD2391@server.vk2pj.dyndns.org> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-3.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: Michiel Boland , freebsd-stable@freebsd.org Subject: Re: fsck_ufs out of swapspace X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 09:49:08 -0000 --e5cjMM5jrdcddfcl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Dec 20, 2011 at 09:51:43AM +1100, Peter Jeremy wrote: > On 2011-Dec-19 22:27:49 +0100, Michiel Boland wrote: > >Problem solved - it was indeed an endian thing. > >The problem is that fsck uses a real_dev_bsize variable that is declared= long,=20 > >but the DIOCGSECTORSIZE ioctl takes an u_int argument. >=20 > To be accurate, this isn't an endian problem, it's a general problem > of passing a pointer to an incorrectly sized object. The bug is > masked on amd64 & iA64 because real_dev_bsize is statically allocated > and therefore initialised to zero. This means the failure to assign > the top 32 bits in the ioctl doesn't affect the final result. >=20 > >A PR has been submitted. >=20 > sparc64/163460 for the record. Thank you for tracking that down. The easier fix is to change the type of real_dev_bsize. I used long only because other n variables keeping the sector size are long, but there is no much reason to use long there. Peter, would you, please retest the +J on non-512 byte sectors, with the patch attached ? diff --git a/sbin/fsck_ffs/fsck.h b/sbin/fsck_ffs/fsck.h index 8091d0f..4e30a7e 100644 --- a/sbin/fsck_ffs/fsck.h +++ b/sbin/fsck_ffs/fsck.h @@ -268,7 +268,7 @@ char snapname[BUFSIZ]; /* when doing snapshots, the nam= e of the file */ char *cdevname; /* name of device being checked */ long dev_bsize; /* computed value of DEV_BSIZE */ long secsize; /* actual disk sector size */ -long real_dev_bsize; +u_int real_dev_bsize; /* actual disk sector size, not overriden */ char nflag; /* assume a no response */ char yflag; /* assume a yes response */ int bkgrdflag; /* use a snapshot to run on an active system */ diff --git a/sbin/fsck_ffs/suj.c b/sbin/fsck_ffs/suj.c index ec8b5ab..b784519 100644 --- a/sbin/fsck_ffs/suj.c +++ b/sbin/fsck_ffs/suj.c @@ -206,7 +206,7 @@ opendisk(const char *devnam) &real_dev_bsize) =3D=3D -1) real_dev_bsize =3D secsize; if (debug) - printf("dev_bsize %ld\n", real_dev_bsize); + printf("dev_bsize %u\n", real_dev_bsize); } =20 /* --e5cjMM5jrdcddfcl Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk7wWe8ACgkQC3+MBN1Mb4jJ4gCePXF1kr1YmEdMhr3YXCoU4a49 CXUAoOxV0l9PaKXGTY1LOvSGmpfMC/J4 =5Ox1 -----END PGP SIGNATURE----- --e5cjMM5jrdcddfcl-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 09:51:41 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EE631106566B; Tue, 20 Dec 2011 09:51:41 +0000 (UTC) (envelope-from christer.solskogen@gmail.com) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2B0258FC12; Tue, 20 Dec 2011 09:51:40 +0000 (UTC) Received: by wibhr1 with SMTP id hr1so2581487wib.13 for ; Tue, 20 Dec 2011 01:51:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=eZXzKbhJ/aJknufgoUTuGgSuDXqIapHqOQEL7vQhu4k=; b=j4u6NEKLCDEzdH9jBfkKHZsqJUCIJxJVxh2TOHVK67tNhTyXyRG1/VebqEzTm30iXO 8QPEHxCxHDfiqOr/8iruMylRUKZexA6K5PoHekfmSaGj+hbhBKQMbmyen6dT5QacLOwQ rLGs7ItwAbRn1ZcH/qyG7noESUMQplM9Fth04= Received: by 10.180.19.138 with SMTP id f10mr3861498wie.3.1324374700162; Tue, 20 Dec 2011 01:51:40 -0800 (PST) MIME-Version: 1.0 Received: by 10.227.57.82 with HTTP; Tue, 20 Dec 2011 01:51:19 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> From: Christer Solskogen Date: Tue, 20 Dec 2011 10:51:19 +0100 Message-ID: To: Garrett Cooper Content-Type: text/plain; charset=UTF-8 Cc: Edho Arief , freebsd-performance@freebsd.org, Alexander Yerenkow , FreeBSD Stable Mailing List , Current FreeBSD Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 09:51:42 -0000 On Tue, Dec 20, 2011 at 10:42 AM, Garrett Cooper wrote: > > As long as I have reliable checksums that match the what the upstream source says is the real thing, it doesn't practically matter where I get my images from. Checksums compared to what? How would you know what the correct checksums for OpenBSD-current is, if it's not built by Theo? -- chs, From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 09:55:37 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6D7881065672; Tue, 20 Dec 2011 09:55:37 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id E8FE58FC1A; Tue, 20 Dec 2011 09:55:36 +0000 (UTC) Received: by ghrr16 with SMTP id r16so941401ghr.13 for ; Tue, 20 Dec 2011 01:55:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=MDysFyqsbkr7dTfBbRyLi93e+kOxXhoDK8XikFwcsuw=; b=weev6e8nHr19Ba5tb2NpTCt1YkeMK7K7ikWTq2c5gcqiM3jNyr5/3W+CZRKrhWvWQ7 uvODo6d7Lv3xmHXM9iSOBErvHWqyWJEIOhg0IgLBWOl9zt5cg3HP6wN2Ei3NImOZ2nRz NDKr9U2qgnCICg7W+iORdF4PnaYX8EwN/nIq8= Received: by 10.236.175.72 with SMTP id y48mr2291729yhl.17.1324374936200; Tue, 20 Dec 2011 01:55:36 -0800 (PST) Received: from starr-wireless.local (c-24-6-49-154.hsd1.ca.comcast.net. [24.6.49.154]) by mx.google.com with ESMTPS id m38sm3707595anq.16.2011.12.20.01.55.34 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 20 Dec 2011 01:55:35 -0800 (PST) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Garrett Cooper In-Reply-To: Date: Tue, 20 Dec 2011 01:55:32 -0800 Content-Transfer-Encoding: quoted-printable Message-Id: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> To: Christer Solskogen X-Mailer: Apple Mail (2.1084) Cc: Edho Arief , freebsd-performance@freebsd.org, Alexander Yerenkow , FreeBSD Stable Mailing List , Current FreeBSD Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 09:55:37 -0000 On Dec 20, 2011, at 1:51 AM, Christer Solskogen wrote: > On Tue, Dec 20, 2011 at 10:42 AM, Garrett Cooper = wrote: >>=20 >> As long as I have reliable checksums that match the what the upstream = source says is the real thing, it doesn't practically matter where I get = my images from. >=20 > Checksums compared to what? How would you know what the correct > checksums for OpenBSD-current is, if it's not built by Theo? Release engineering for FreeBSD produces SHA256 checksums for = all official releases. AFAIK though they're only in the announcement = emails and not stored anywhere else. I can't speak for OpenBSD's release process. Thanks, -Garrett= From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 09:59:38 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F04BB106567D; Tue, 20 Dec 2011 09:59:38 +0000 (UTC) (envelope-from christer.solskogen@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 19AB08FC20; Tue, 20 Dec 2011 09:59:37 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so12100655wgb.31 for ; Tue, 20 Dec 2011 01:59:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; bh=z4QhDsp0VyZDq+EW4mX25buZmYwLO4eSaoxVxI5K1r0=; b=EpMfDVYoxb4NH/nMwyJyGMhLUZFg9uCOyqQqJTG81ohO5zGML0ZLEYgiJ62gvPCknF L7J+nSiVZvn/+44QBOfX73HeudXQnsynQtl57XXvqM9Ys6MWX+vQOO0/CNklucbfVL/X KZYNQG6Y2L9DRqxuos7ViV2XCyL7REDP8QuPc= Received: by 10.216.136.231 with SMTP id w81mr788584wei.3.1324375177146; Tue, 20 Dec 2011 01:59:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.227.57.82 with HTTP; Tue, 20 Dec 2011 01:59:15 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> From: Christer Solskogen Date: Tue, 20 Dec 2011 10:59:15 +0100 Message-ID: To: Garrett Cooper Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Edho Arief , freebsd-performance@freebsd.org, Alexander Yerenkow , FreeBSD Stable Mailing List , Current FreeBSD Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 09:59:39 -0000 On Tue, Dec 20, 2011 at 10:55 AM, Garrett Cooper wrote= : > =C2=A0 =C2=A0 =C2=A0 =C2=A0Release engineering for FreeBSD produces SHA25= 6 checksums for all official releases. AFAIK though they're only in the ann= ouncement emails and not stored anywhere else. > =C2=A0 =C2=A0 =C2=A0 =C2=A0I can't speak for OpenBSD's release process. > Thanks, So why do you want to download from a non-official site then? What do you gain with that? --=20 chs, From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:05:16 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 852011065673 for ; Tue, 20 Dec 2011 10:05:16 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 314B88FC13 for ; Tue, 20 Dec 2011 10:05:15 +0000 (UTC) Received: by ghrr16 with SMTP id r16so945425ghr.13 for ; Tue, 20 Dec 2011 02:05:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=kVd8UBTZMv7IHwY6VOwz8O9ZZkkAnvhEJYsyHGg7Gw8=; b=rxjC/xC7pVllkHy/Dz3hhG0JYGh/0YXi2gWwjW++U0XZ03zmJFfvH0/cxX0/QvdyE1 se1tmo3gADIAy7Min460houA3KPAtTrbmaZHlf1GcWEvkkq3evzCa8JW2t1Dcxmpenj4 HR+W38EhbBCgp3/tv87gqANxsO7MaqG/y57Ag= Received: by 10.236.201.137 with SMTP id b9mr1991915yho.124.1324374152574; Tue, 20 Dec 2011 01:42:32 -0800 (PST) Received: from starr-wireless.local (c-24-6-49-154.hsd1.ca.comcast.net. [24.6.49.154]) by mx.google.com with ESMTPS id n5sm2321003yhk.1.2011.12.20.01.42.27 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 20 Dec 2011 01:42:31 -0800 (PST) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Garrett Cooper In-Reply-To: Date: Tue, 20 Dec 2011 01:42:20 -0800 Content-Transfer-Encoding: quoted-printable Message-Id: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> To: Christer Solskogen X-Mailer: Apple Mail (2.1084) Cc: Edho Arief , freebsd-performance@freebsd.org, Alexander Yerenkow , FreeBSD Stable Mailing List , Current FreeBSD Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:05:16 -0000 On Dec 20, 2011, at 1:01 AM, Christer Solskogen wrote: > On Mon, Dec 19, 2011 at 2:16 PM, Alexander Yerenkow = wrote: >> FreeBSD currently have very obscure, closed community. To get in = touch, you >> need to subscribe to several mail lists, constantly read them, I've = just >> found recently (my shame of course) in mail list that there is = service ( >> pub.allbsd.org) which constantly building current versions. This is = great, >> but at homepage of freebsd.org there is no word about it :) >=20 > That's because it's not official. Do you take the risk? Would a > multi-milion-dollar company do that? > For your private server, sure it's probably fine. But how do you know > that those files are not contaminated? > (That being said, the purpose of that service is good. And the files > there a most probably 100% fine. But if it's not official... then..) As long as I have reliable checksums that match the what the upstream = source says is the real thing, it doesn't practically matter where I get = my images from. -Garrett= From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:10:37 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7168B106566C for ; Tue, 20 Dec 2011 10:10:37 +0000 (UTC) (envelope-from kamikaze@bsdforen.de) Received: from mail.server1.bsdforen.de (bsdforen.de [82.193.243.81]) by mx1.freebsd.org (Postfix) with ESMTP id 34BE98FC17 for ; Tue, 20 Dec 2011 10:10:36 +0000 (UTC) Received: from mobileKamikaze.norad (HSI-KBW-091-089-161-008.hsi2.kabel-badenwuerttemberg.de [91.89.161.8]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.server1.bsdforen.de (Postfix) with ESMTPSA id 047727E882; Tue, 20 Dec 2011 11:10:35 +0100 (CET) Message-ID: <4EF05F1A.6060504@bsdforen.de> Date: Tue, 20 Dec 2011 11:10:34 +0100 From: Dominic Fandrey User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111216 Thunderbird/8.0 MIME-Version: 1.0 To: Ian Smith References: <4EEAF70E.1040104@bsdforen.de> <20111217000216.Y64681@sola.nimnet.asn.au> In-Reply-To: <20111217000216.Y64681@sola.nimnet.asn.au> Content-Type: text/plain; charset=ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: battery display broken X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:10:37 -0000 On 16/12/2011 16:28, Ian Smith wrote: > On Fri, 16 Dec 2011, Dominic Fandrey wrote: > > It seems something broke with the battery display. Last night it > > showed 94% remaining capacity for more than 2 hours. > > > > Afterwards I docked the machine (HP6510b) and rebooted it. Since then > > more than 8 hours have passed, but it still shows 16% (the LED indicators > > state that the battery is full and no longer charging). > > ... > > At least four things can go wrong. The battery charging circuit might > be broken (my first T23 failed that way after 5 years); the battery > might just need 'conditioning' (discharged to exhaustion, beyond normal > low-battery shutdown, then fully charged - perhaps twice), to reset its > internal Coulomb Counter; the CC chip may be faulty; or the battery > itself may be failing / have failed, usually one cell first. The battery still does the expected 3 hours. That's about as much as I can expect. > Is the battery hot at this stage? If that 'Present rate' is correct, a > 3.35A/39.6W charge should tend to overheat the battery over time, if > charging continues beyond full capacity, which may indicate a bad cell. Are you certain about that? Decent lithium cells can be charged with 6A without becoming perceivably warmer. I'd expect that at least 39W of the 39.6W get stored in the battery. > 11.8V seems too low for a fully-charged 10.8V nominal LIon battery. I > have several 4.0 and 4.4Ah like the below, which charge to ~12.4V, and > only get down to 11.8V while discharging, at around 85% nom. capacity. It states 16% capacity. Everything fits that. It simply doesn't update the readings. When I boot with a charged battery: Present voltage: 12540 mV > Interesting that your LEDs display a different view; perhaps BIOS + EC > just monitors voltage and cuts charge, but then what's reporting that > fairly high charge rate? I'd expect the Embedded Controller to be doing > that .. any dmesg indications of ACPI problems talking to the EC? Well, that's interesting, it reports 2 batteries: battery0: on acpi0 battery1: on acpi0 I think there is an option for a second battery, but I'm certainly not using it. > The 16% is likely from the battery's onboard coulomb counter, but then > so might be the (bogus?) charge rate report. All speculative, I know .. The data is all perfectly fine, it was simply from a moment in time a couple hours in the past. It seems the reading is cached and never updated. > All that said, I don't know specifically how HP do things, or what > normal full charge voltage is expected. Tried another battery? Tried another OS. Windows shows the battery status just fine. So did RELENG_8. This is a regression in RELENG_9 there isn't a problem with the battery. Or if there is RELENG_8 was able to cope. -- A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing on usenet and in e-mail? From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:10:52 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0719106564A for ; Tue, 20 Dec 2011 10:10:52 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 1A6878FC0A for ; Tue, 20 Dec 2011 10:10:51 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id MAA25760; Tue, 20 Dec 2011 12:10:48 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1Rcwem-000JCC-3j; Tue, 20 Dec 2011 12:10:48 +0200 Message-ID: <4EF05F27.8030902@FreeBSD.org> Date: Tue, 20 Dec 2011 12:10:47 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Ganael LAPLANCHE References: <20111220080437.M63044@martymac.org> In-Reply-To: <20111220080437.M63044@martymac.org> X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@FreeBSD.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:10:52 -0000 on 20/12/2011 10:08 Ganael LAPLANCHE said the following: > Hi folks, > > I am trying to use mmap(2) with a hint address. Unfortunately, this address > seems to be ignored and I never manage to get the desired one, while it > seems to be free. [snip] > Using MAP_FIXED, I can get the desired address, but it is overkill (it > replaces > any previous mappings and its use is discouraged, see mmap(2)) and > should not > be needed here. > > Am I doing something wrong here ? Can the following code explain what you are seeing? /* * XXX for non-fixed mappings where no hint is provided or * the hint would fall in the potential heap space, * place it after the end of the largest possible heap. * * There should really be a pmap call to determine a reasonable * location. */ PROC_LOCK(td->td_proc); if (addr == 0 || (addr >= round_page((vm_offset_t)vms->vm_taddr) && addr < round_page((vm_offset_t)vms->vm_daddr + lim_max(td->td_proc, RLIMIT_DATA)))) addr = round_page((vm_offset_t)vms->vm_daddr + lim_max(td->td_proc, RLIMIT_DATA)); PROC_UNLOCK(td->td_proc); -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:13:16 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 805501065677; Tue, 20 Dec 2011 10:13:16 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 36AC28FC27; Tue, 20 Dec 2011 10:13:16 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Rcwh8-0002vm-Vg>; Tue, 20 Dec 2011 11:13:15 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Rcwh8-0005bj-SA>; Tue, 20 Dec 2011 11:13:14 +0100 Message-ID: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 11:13:14 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Current FreeBSD , FreeBSD Stable Mailing List X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig8F543234D0CFDE0730DB881A" X-Originating-IP: 130.133.86.198 Cc: Subject: x11/sessreg: build fails with CLANG in FreeBSD 9.0-PRERELEASE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:13:16 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8F543234D0CFDE0730DB881A Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On a freshly updated box the installation of x11/sessreg fails with the shown message below. On all boxes I run with FBSD 9 or 10 (all amd64, CLANG build) the build and installation works fine. Since I update the box from 8.2-STABLE to 9.0-PRE last night, cleaning up all ports and having them rebuilt from scratch, I guess I have a problem with remnants (or missing compatibility?) in the system. Where to start looking? ttyslot looks like a base system function. Regards, thanks in advance, Oliver =3D=3D=3D> Building for sessreg-1.0.7 /usr/bin/make all-recursive Making all in man GEN filenames.sed GEN sessreg.1 CC sessreg.o sessreg.c:281:27: warning: implicit declaration of function 'ttyslot' is invalid in C99 [-Wimplicit-function-declaration] sysnerr (slot_number =3D ttyslot (), "ttyslot"); ^ 1 warning generated. CCLD sessreg sessreg.o: In function `main': sessreg.c:(.text+0x7bf): undefined reference to `ttyslot' clang: error: linker command failed with exit code 1 (use -v to see invocation) *** Error code 1 Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. *** Error code 1 Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. *** Error code 1 Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. *** Error code 1 Stop in /usr/ports/x11/sessreg. --------------enig8F543234D0CFDE0730DB881A Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iF4EAREIAAYFAk7wX7oACgkQU6Ni+wtCKv+2bgD/Tv1Cz6LAL79PZ1XnB1u54N3x Vmc0ZQ4VvWUCDufkN5kA/1LqUnO+FMRNqCw8TIjyJ+wQro/lgPRFnWk3NTfeDl3I =LTAu -----END PGP SIGNATURE----- --------------enig8F543234D0CFDE0730DB881A-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:21:20 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29613106564A for ; Tue, 20 Dec 2011 10:21:20 +0000 (UTC) (envelope-from tijl@coosemans.org) Received: from mailrelay009.isp.belgacom.be (mailrelay009.isp.belgacom.be [195.238.6.176]) by mx1.freebsd.org (Postfix) with ESMTP id 78E3A8FC13 for ; Tue, 20 Dec 2011 10:21:19 +0000 (UTC) X-Belgacom-Dynamic: yes X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Av4EAKJe8E5bsVo6/2dsb2JhbABDqSqCTIEGgXIBAQVWIxALGC45HogVt2uDfIgQBKcw Received: from 58.90-177-91.adsl-dyn.isp.belgacom.be (HELO kalimero.tijl.coosemans.org) ([91.177.90.58]) by relay.skynet.be with ESMTP; 20 Dec 2011 11:10:36 +0100 Received: from kalimero.tijl.coosemans.org (kalimero.tijl.coosemans.org [127.0.0.1]) by kalimero.tijl.coosemans.org (8.14.5/8.14.5) with ESMTP id pBKAAY8D002925; Tue, 20 Dec 2011 11:10:35 +0100 (CET) (envelope-from tijl@coosemans.org) From: Tijl Coosemans To: freebsd-stable@freebsd.org Date: Tue, 20 Dec 2011 11:10:26 +0100 User-Agent: KMail/1.13.7 (FreeBSD/9.0-RC2; KDE/4.7.3; i386; ; ) References: <20111220080437.M63044@martymac.org> In-Reply-To: <20111220080437.M63044@martymac.org> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1645308.pnkqAZZbLn"; protocol="application/pgp-signature"; micalg=pgp-sha256 Content-Transfer-Encoding: 7bit Message-Id: <201112201110.32559.tijl@coosemans.org> Cc: Ganael LAPLANCHE Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:21:20 -0000 --nextPart1645308.pnkqAZZbLn Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: quoted-printable On Tuesday 20 December 2011 09:08:18 Ganael LAPLANCHE wrote: > Hi folks, >=20 > I am trying to use mmap(2) with a hint address. Unfortunately, this addre= ss > seems to be ignored and I never manage to get the desired one, while it > seems to be free. >=20 > Here is my code (the same code on NetBSD and GNU/Linux returns the hint > address) : >=20 > 8< ----------- >8 > #include > #include > #include >=20 > /* mmap */ > #include >=20 > /* getpagesize */ > #include >=20 > /* round_page */ > #include >=20 > int main(void) > { > size_t map_size =3D getpagesize(); >=20 > /* first call, ask for one page, with hint */ > char *map_hint =3D (char*)round_page(512*1024*1024); > printf("=3D> calling mmap with hint =3D %p, size =3D %zu\n", map_hint, > map_size); > void *addr =3D mmap(map_hint, map_size, PROT_READ | PROT_WRITE | > PROT_EXEC, > MAP_ANON | MAP_PRIVATE, -1, 0); > if (addr =3D=3D MAP_FAILED) { > printf("mmap failed: %s\n", strerror(errno)); > } > else { > printf("mmap succeeded: addr =3D %p\n", addr); > #ifdef SLEEP > /* leave time to use 'procstat -v' */ > sleep(10); > #endif > if(munmap(addr, map_size) !=3D 0) { > printf("munmap failed: %s\n", strerror(errno)); > } > } >=20 > /* second call, one page, without hint */ > map_hint =3D 0; > printf("=3D> calling mmap without hint, size =3D %zu\n", map_size); > addr =3D mmap(map_hint, map_size, PROT_READ | PROT_WRITE | PROT_EXEC, > MAP_ANON | MAP_PRIVATE, -1, 0); > if (addr =3D=3D MAP_FAILED) { > printf("mmap failed: %s\n", strerror(errno)); > } > else { > printf("mmap succeeded: addr =3D %p\n", addr); > #ifdef SLEEP > /* leave time to use 'procstat -v' */ > sleep(10); > #endif > if(munmap(addr, map_size) !=3D 0) { > printf("munmap failed: %s\n", strerror(errno)); > } > } > return (0); > } > 8< ----------- >8 >=20 > and its output : >=20 > 1) On an i386 machine, FreeBSD 8.2-RELEASE : >=20 > $ ./test-mmap > =3D> calling mmap with hint =3D 0x20000000, size =3D 4096 > mmap succeeded: addr =3D 0x281a8000 > =3D> calling mmap without hint, size =3D 4096 > mmap succeeded: addr =3D 0x281a8000 >=20 > $ procstat -v 1685 > PID START END PRT RES PRES REF SHD FL TP PATH > 1685 0x8048000 0x8049000 r-x 1 0 1 0 CN vn /tmp/test-mmap > 1685 0x8049000 0x8100000 rw- 1 0 1 0 -- df > 1685 0x28049000 0x28078000 r-x 47 0 82 41 CN vn /libexec/ld-elf.s= o.1 > 1685 0x28078000 0x2807a000 rw- 2 0 1 0 C- vn /libexec/ld-elf.s= o.1 > 1685 0x2807a000 0x2808d000 rw- 12 0 1 0 -- df > 1685 0x2808d000 0x2818b000 r-x 134 0 82 41 CN vn /lib/libc.so.7 > 1685 0x2818b000 0x28191000 rw- 6 0 1 0 C- vn /lib/libc.so.7 > 1685 0x28191000 0x281a8000 rw- 5 0 1 0 -- df > 1685 0x281a8000 0x281a9000 rwx 0 0 0 0 -- -- > 1685 0x28200000 0x28300000 rw- 2 0 1 0 -- df > 1685 0xbfbe0000 0xbfc00000 rwx 3 0 1 0 -- df >=20 > 2) On an amd64 machine, FreeBSD 8.2-RELEASE : >=20 > $ ./test-mmap > =3D> calling mmap with hint =3D 0x20000000, size =3D 4096 > mmap succeeded: addr =3D 0x800538000 > =3D> calling mmap without hint, size =3D 4096 > mmap succeeded: addr =3D 0x800538000 >=20 > $ procstat -v 38899 > PID START END PRT RES PRES REF SHD FL TP P= ATH > 38899 0x400000 0x401000 r-x 1 0 1 0 CN vn > /tmp/test-mmap > 38899 0x500000 0x600000 rw- 2 0 1 0 -- df=20 > 38899 0x800500000 0x800530000 r-x 48 0 218 95 CN vn > /libexec/ld-elf.so.1 > 38899 0x800530000 0x800538000 rw- 7 0 2 0 -- df=20 > 38899 0x800538000 0x800539000 rwx 0 0 2 0 -- df=20 > 38899 0x80062f000 0x800637000 rw- 8 0 1 0 C- vn > /libexec/ld-elf.so.1 > 38899 0x800637000 0x800646000 rw- 5 0 1 0 -- df=20 > 38899 0x800646000 0x80074e000 r-x 146 0 218 95 CN vn > /lib/libc.so.7 > 38899 0x80074e000 0x80084e000 --- 0 0 2 0 -- df=20 > 38899 0x80084e000 0x80086d000 rw- 31 0 1 0 C- vn > /lib/libc.so.7 > 38899 0x80086d000 0x800888000 rw- 6 0 2 0 -- df=20 > 38899 0x800a00000 0x800c00000 rw- 5 0 1 0 -- df=20 > 38899 0x7ffffffe0000 0x800000000000 rwx 3 0 1 0 -- df=20 >=20 > Using MAP_FIXED, I can get the desired address, but it is overkill (it > replaces > any previous mappings and its use is discouraged, see mmap(2)) and > should not > be needed here. >=20 > Am I doing something wrong here ? =46reeBSD reserves quite a bit of space for brk(2) style heap. Your program will work if you use higher addresses. You can also shrink the reserved space either system wide by setting kern.maxdsiz sysctl in /boot/loader.conf, or in your program by setting the maximum RLIMIT_DATA with setrlimit(2). --nextPart1645308.pnkqAZZbLn Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iF4EABEIAAYFAk7wXxgACgkQfoCS2CCgtitxAAD9HlZklV0Miz9+MpymfgTXzaiL LKwb6vm72wfKDBbf5d8A/18OtAG0rnsth42dZPqKJE3VOgOvL74VFnpQ2GiIHX1F =H3rU -----END PGP SIGNATURE----- --nextPart1645308.pnkqAZZbLn-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:31:21 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FE0E1065673 for ; Tue, 20 Dec 2011 10:31:21 +0000 (UTC) (envelope-from clbuisson@orange.fr) Received: from smtp.smtpout.orange.fr (smtp07.smtpout.orange.fr [80.12.242.129]) by mx1.freebsd.org (Postfix) with ESMTP id 363F38FC1C for ; Tue, 20 Dec 2011 10:31:20 +0000 (UTC) Received: from localhost ([109.223.129.60]) by mwinf5d30 with ME id BN1G1i00C1JKkXh03N1HtH; Tue, 20 Dec 2011 11:01:17 +0100 Message-ID: <4EF05CEC.6080603@orange.fr> Date: Tue, 20 Dec 2011 11:01:16 +0100 From: Claude Buisson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.9.2.24) Gecko/20111114 Thunderbird/3.1.16 MIME-Version: 1.0 To: FreeBSD Current Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Is the svn2cvs gateway down ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:31:21 -0000 Hi, It seems (from my own csup's and cvswe.cgi) that the src commits are lost, starting with r228697 Sun Dec 18 22:04:55 2011) What is going on (or off) ? Claude Buisson From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 10:32:25 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 74ABF106564A; Tue, 20 Dec 2011 10:32:25 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 2C4B38FC14; Tue, 20 Dec 2011 10:32:24 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Rcwzg-0000pb-6K>; Tue, 20 Dec 2011 11:32:24 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Rcwzg-0006wJ-3B>; Tue, 20 Dec 2011 11:32:24 +0100 Message-ID: <4EF06432.8020001@mail.zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 11:32:18 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Current FreeBSD , FreeBSD Stable Mailing List References: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> In-Reply-To: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig0F2296DBBA2AA2D47BD9FF1A" X-Originating-IP: 130.133.86.198 Cc: Subject: Re: x11/sessreg: build fails with CLANG in FreeBSD 9.0-PRERELEASE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 10:32:25 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig0F2296DBBA2AA2D47BD9FF1A Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/20/11 11:13, O. Hartmann wrote: > On a freshly updated box the installation of x11/sessreg fails with the= > shown message below. > On all boxes I run with FBSD 9 or 10 (all amd64, CLANG build) the build= > and installation works fine. >=20 > Since I update the box from 8.2-STABLE to 9.0-PRE last night, cleaning > up all ports and having them rebuilt from scratch, I guess I have a > problem with remnants (or missing compatibility?) in the system. >=20 > Where to start looking? ttyslot looks like a base system function. >=20 >=20 > Regards, thanks in advance, > Oliver >=20 > =3D=3D=3D> Building for sessreg-1.0.7 > /usr/bin/make all-recursive > Making all in man > GEN filenames.sed > GEN sessreg.1 > CC sessreg.o > sessreg.c:281:27: warning: implicit declaration of function 'ttyslot' i= s > invalid in C99 [-Wimplicit-function-declaration] > sysnerr (slot_number =3D ttyslot (), "ttyslot")= ; > ^ > 1 warning generated. > CCLD sessreg > sessreg.o: In function `main': > sessreg.c:(.text+0x7bf): undefined reference to `ttyslot' > clang: error: linker command failed with exit code 1 (use -v to see > invocation) > *** Error code 1 >=20 > Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. > *** Error code 1 >=20 > Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. > *** Error code 1 >=20 > Stop in /usr/ports/x11/sessreg/work/sessreg-1.0.7. > *** Error code 1 >=20 > Stop in /usr/ports/x11/sessreg. Sorry for the noise. As I gave myself the answer, some remnants polluted the system and I got rid by simply call the propper make delete-old-libs/files in /usr/src. Oliver --------------enig0F2296DBBA2AA2D47BD9FF1A Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iF4EAREIAAYFAk7wZDgACgkQU6Ni+wtCKv+23gD9Fngc8YG5GliCNSv4BcTLbJAm hIFms0fnaaI1UrOt4fcA/27ei3GiuGsokHWF4ItTjnslKi1hBk3uMCNHCjhzXo2Q =nDF7 -----END PGP SIGNATURE----- --------------enig0F2296DBBA2AA2D47BD9FF1A-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 11:02:03 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 51848106564A for ; Tue, 20 Dec 2011 11:02:03 +0000 (UTC) (envelope-from michiel@boland.org) Received: from smtp-vbr15.xs4all.nl (smtp-vbr15.xs4all.nl [194.109.24.35]) by mx1.freebsd.org (Postfix) with ESMTP id DA2A78FC18 for ; Tue, 20 Dec 2011 11:02:01 +0000 (UTC) Received: from charlemagne.boland.org (59-36-215.ftth.xms.internl.net [82.215.36.59]) (authenticated bits=0) by smtp-vbr15.xs4all.nl (8.13.8/8.13.8) with ESMTP id pBKAn5W2021273 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NO) for ; Tue, 20 Dec 2011 11:49:05 +0100 (CET) (envelope-from michiel@boland.org) Message-ID: <4EF06821.3060106@boland.org> Date: Tue, 20 Dec 2011 11:49:05 +0100 From: Michiel Boland User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.24) Gecko/20111110 Thunderbird/3.1.16 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> In-Reply-To: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by XS4ALL Virus Scanner Subject: Re: x11/sessreg: build fails with CLANG in FreeBSD 9.0-PRERELEASE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 11:02:03 -0000 On 12/20/2011 11:13, O. Hartmann wrote: > On a freshly updated box the installation of x11/sessreg fails with the > shown message below. > On all boxes I run with FBSD 9 or 10 (all amd64, CLANG build) the build > and installation works fine. > > Since I update the box from 8.2-STABLE to 9.0-PRE last night, cleaning > up all ports and having them rebuilt from scratch, I guess I have a > problem with remnants (or missing compatibility?) in the system. > > Where to start looking? ttyslot looks like a base system function. Looks like you still have /usr/include/utmp.h Do 'make delete-old' in /usr/src Cheers Michiel From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 11:08:56 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 636EC106564A for ; Tue, 20 Dec 2011 11:08:56 +0000 (UTC) (envelope-from ohartman@mail.zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 1A6DA8FC08 for ; Tue, 20 Dec 2011 11:08:55 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RcxZ1-0006Y7-60>; Tue, 20 Dec 2011 12:08:55 +0100 Received: from telesto.geoinf.fu-berlin.de ([130.133.86.198]) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RcxZ1-00013z-2p>; Tue, 20 Dec 2011 12:08:55 +0100 Message-ID: <4EF06CC0.2060002@mail.zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 12:08:48 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Michiel Boland References: <4EF05FBA.8030303@mail.zedat.fu-berlin.de> <4EF06821.3060106@boland.org> In-Reply-To: <4EF06821.3060106@boland.org> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig061E8B9F915410157A9F4524" X-Originating-IP: 130.133.86.198 Cc: freebsd-stable@freebsd.org Subject: Re: x11/sessreg: build fails with CLANG in FreeBSD 9.0-PRERELEASE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 11:08:56 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig061E8B9F915410157A9F4524 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/20/11 11:49, Michiel Boland wrote: > On 12/20/2011 11:13, O. Hartmann wrote: >> On a freshly updated box the installation of x11/sessreg fails with th= e >> shown message below. >> On all boxes I run with FBSD 9 or 10 (all amd64, CLANG build) the buil= d >> and installation works fine. >> >> Since I update the box from 8.2-STABLE to 9.0-PRE last night, cleaning= >> up all ports and having them rebuilt from scratch, I guess I have a >> problem with remnants (or missing compatibility?) in the system. >> >> Where to start looking? ttyslot looks like a base system function. >=20 > Looks like you still have /usr/include/utmp.h > Do 'make delete-old' in /usr/src >=20 > Cheers > Michiel Hello. Seconds after I wrote and sent the posting I remembered about cleaning up the system ... I did and everything runs smooth and well now. Thanks. Oliver --------------enig061E8B9F915410157A9F4524 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iF4EAREIAAYFAk7wbMcACgkQU6Ni+wtCKv8foQD+MD2z510Ap7ghDcCOHf2BUQxP Ir+vNd5pRNA8BpYsK0QBAIG0KyDuojuBvXW+/dJA8IODVzsYi+n8E9nBVfmE5WKl =pmQL -----END PGP SIGNATURE----- --------------enig061E8B9F915410157A9F4524-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 14:02:03 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18C301065675 for ; Tue, 20 Dec 2011 14:02:03 +0000 (UTC) (envelope-from ganael.laplanche@martymac.org) Received: from data.galacsys.net (webmail.galacsys.net [217.24.81.215]) by mx1.freebsd.org (Postfix) with ESMTP id BC65E8FC28 for ; Tue, 20 Dec 2011 14:02:02 +0000 (UTC) Received: from martymac.org (webmail.galacsys.net [217.24.81.215]) by data.galacsys.net (Postfix) with ESMTP id 7E0021713A5; Tue, 20 Dec 2011 15:02:01 +0100 (CET) From: "Ganael LAPLANCHE" To: Andriy Gapon , Tijl Coosemans X-Openwebmail-Date: Tue, 20 Dec 2011 16:02:01 +0200 Message-Id: <20111220134716.M62917@martymac.org> In-Reply-To: <4EF05F27.8030902@FreeBSD.org> References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> X-Mailer: Open WebMail 2.01 20030425 X-OriginatingIP: 157.99.64.43 (ganael.laplanche@martymac.org) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Date: Tue, 20 Dec 2011 15:02:01 +0100 (CET) Cc: freebsd-stable@FreeBSD.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 14:02:03 -0000 Hi Andriy, Hi Tijl, On Tue, 20 Dec 2011 12:10:47 +0200, Andriy Gapon wrote > Can the following code explain what you are seeing? > [...] Yes, for sure. I had seen this part of the code but, to be honest, had not understood the meaning of this computation. On Tue, 20 Dec 2011 11:10:26 +0100, Tijl Coosemans wrote > FreeBSD reserves quite a bit of space for brk(2) style heap. Your > program will work if you use higher addresses. > > You can also shrink the reserved space either system wide by setting > kern.maxdsiz sysctl in /boot/loader.conf, or in your program > by setting the maximum RLIMIT_DATA with setrlimit(2). Thanks for the explanation! Reducing reserved space for data segment seems to work. But there is still something I don't understand : on the Linux machine where I ran my test program, the current RLIMIT_DATA is set to 0xffffffff/0xffffffff and I can manage to mmap at address 0x20000000. If I set the same limit on FreeBSD, I won't get the mapping at 0x20000000. So, there *is* a difference of behaviour between the two systems, but I don't understand why. Thanks to both of you, Best regards, -- Ganael LAPLANCHE http://www.martymac.org | http://contribs.martymac.org FreeBSD: martymac , http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 14:31:49 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 393801065670; Tue, 20 Dec 2011 14:31:49 +0000 (UTC) (envelope-from ganael.laplanche@martymac.org) Received: from data.galacsys.net (webmail.galacsys.net [217.24.81.215]) by mx1.freebsd.org (Postfix) with ESMTP id F1E888FC0C; Tue, 20 Dec 2011 14:31:48 +0000 (UTC) Received: from martymac.org (webmail.galacsys.net [217.24.81.215]) by data.galacsys.net (Postfix) with ESMTP id 27269171372; Tue, 20 Dec 2011 15:31:48 +0100 (CET) From: "Ganael LAPLANCHE" To: Andriy Gapon , Tijl Coosemans X-Openwebmail-Date: Tue, 20 Dec 2011 16:31:48 +0200 Message-Id: <20111220142740.M29405@martymac.org> In-Reply-To: <20111220134716.M62917@martymac.org> References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> <20111220134716.M62917@martymac.org> X-Mailer: Open WebMail 2.01 20030425 X-OriginatingIP: 157.99.64.43 (ganael.laplanche@martymac.org) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Date: Tue, 20 Dec 2011 15:31:48 +0100 (CET) Cc: freebsd-stable@FreeBSD.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 14:31:49 -0000 On Tue, 20 Dec 2011 15:02:01 +0100 (CET), Ganael LAPLANCHE wrote > But there is still something I don't understand : on the Linux > machine where I ran my test program, the current RLIMIT_DATA > is set to 0xffffffff/0xffffffff and I can manage to mmap at > address 0x20000000. If I set the same limit on FreeBSD, I > won't get the mapping at 0x20000000. So, there *is* a > difference of behaviour between the two systems, but I don't > understand why. Well, in fact, two things remain not very clear for me : - Why are mmap()s performed *after* data segment ? => It seems they can go within, on GNU/Linux and NetBSD. - Why do we have such a default value for datasize (8.2, amd64) : $ limits Resource limits (current): cputime infinity secs filesize infinity kB datasize 33554432 kB this is HUGE ! -- Ganael LAPLANCHE http://www.martymac.org | http://contribs.martymac.org FreeBSD: martymac , http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 15:03:09 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A92A1065675 for ; Tue, 20 Dec 2011 15:03:09 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id C604B8FC19 for ; Tue, 20 Dec 2011 15:03:08 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id RAA02742; Tue, 20 Dec 2011 17:03:05 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1Rd1Dc-000JQU-Mq; Tue, 20 Dec 2011 17:03:04 +0200 Message-ID: <4EF0A3A7.80309@FreeBSD.org> Date: Tue, 20 Dec 2011 17:03:03 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Ganael LAPLANCHE References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> <20111220134716.M62917@martymac.org> <20111220142740.M29405@martymac.org> In-Reply-To: <20111220142740.M29405@martymac.org> X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit Cc: Tijl Coosemans , freebsd-stable@FreeBSD.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 15:03:09 -0000 on 20/12/2011 16:31 Ganael LAPLANCHE said the following: > On Tue, 20 Dec 2011 15:02:01 +0100 (CET), Ganael LAPLANCHE wrote > >> But there is still something I don't understand : on the Linux >> machine where I ran my test program, the current RLIMIT_DATA >> is set to 0xffffffff/0xffffffff and I can manage to mmap at >> address 0x20000000. If I set the same limit on FreeBSD, I >> won't get the mapping at 0x20000000. So, there *is* a >> difference of behaviour between the two systems, but I don't >> understand why. > > Well, in fact, two things remain not very clear for me : > > - Why are mmap()s performed *after* data segment ? > => It seems they can go within, on GNU/Linux and NetBSD. > > - Why do we have such a default value for datasize (8.2, amd64) : > > $ limits > Resource limits (current): > cputime infinity secs > filesize infinity kB > datasize 33554432 kB > > this is HUGE ! Just a guess - this might be some sort of optimization to keep virtual address range of dynamic allocations untouched by unrelated mmap calls. Not sure if that's so and how useful could that be. svn log / svn annotate of the file may reveal more details. -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 15:10:34 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3E09A1065673; Tue, 20 Dec 2011 15:10:34 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:130:3ffc::401:25]) by mx1.freebsd.org (Postfix) with ESMTP id C4BC88FC15; Tue, 20 Dec 2011 15:10:33 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id B412525D39FE; Tue, 20 Dec 2011 15:10:32 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id E60DEBD7688; Tue, 20 Dec 2011 15:10:31 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id xm04MeSuT5Tu; Tue, 20 Dec 2011 15:10:31 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 1CC81BD768D; Tue, 20 Dec 2011 15:10:30 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: <4EF05CEC.6080603@orange.fr> Date: Tue, 20 Dec 2011 15:10:30 +0000 Content-Transfer-Encoding: 7bit Message-Id: References: <4EF05CEC.6080603@orange.fr> To: Claude Buisson X-Mailer: Apple Mail (2.1084) Cc: stable@freebsd.org, FreeBSD Current Subject: Re: Is the svn2cvs gateway down ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 15:10:34 -0000 On 20. Dec 2011, at 10:01 , Claude Buisson wrote: > It seems (from my own csup's and cvswe.cgi) that the src commits are lost, > starting with r228697 Sun Dec 18 22:04:55 2011) > > What is going on (or off) ? Re $subject -- yes. It will be worked on. -- Bjoern A. Zeeb You have to have visions! Stop bit received. Insert coin for new address family. From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 16:00:42 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2D436106566C for ; Tue, 20 Dec 2011 16:00:42 +0000 (UTC) (envelope-from patfbsd@davenulle.org) Received: from smtp.lamaiziere.net (net.lamaiziere.net [94.23.254.147]) by mx1.freebsd.org (Postfix) with ESMTP id DF8F78FC15 for ; Tue, 20 Dec 2011 16:00:41 +0000 (UTC) Received: from baby-jane.lamaiziere.net (mr129166.cri.univ-rennes1.fr [129.20.129.166]) by smtp.lamaiziere.net (Postfix) with ESMTPA id CDE3EFAA31A5 for ; Tue, 20 Dec 2011 16:42:47 +0100 (CET) Received: from mr129166 (localhost [127.0.0.1]) by baby-jane.lamaiziere.net (Postfix) with ESMTP id 8534D7545 for ; Tue, 20 Dec 2011 16:41:48 +0100 (CET) Date: Tue, 20 Dec 2011 16:41:48 +0100 From: Patrick Lamaiziere To: FreeBSD Stable Mailing List Message-ID: <20111220164148.4293d21c@mr129166> X-Mailer: Claws Mail 3.7.10 (GTK+ 2.24.6; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Subject: [9.0-RC3] tar xf with zip archive is broken X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 16:00:42 -0000 Hello, Looks like tar -xf with zip archive is broken on 9.0. It creates the directories but files are empty. See with nagios-checker firefox plugin (.xpi which is a zip file) http://code.google.com/p/nagioschecker/downloads/detail?name=nagioschecker-0.16.xpi&can=2&q= total 20 drwxr-xr-x 4 patrick patrick 6 20 déc 16:35 ./ drwxr-xr-x 43 patrick patrick 89 20 déc 16:34 ../ drwxr-xr-x 3 patrick patrick 3 20 déc 16:35 chrome/ -rwxr-xr-x 1 patrick patrick 0 15 déc 2010 chrome.manifest* drwxr-xr-x 3 patrick patrick 3 20 déc 16:35 defaults/ -rwxr-xr-x 1 patrick patrick 0 31 déc 2010 install.rdf* On 8.2 that works fine. Regards. From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 16:12:07 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C1653106564A; Tue, 20 Dec 2011 16:12:07 +0000 (UTC) (envelope-from ganael.laplanche@martymac.org) Received: from data.galacsys.net (webmail.galacsys.net [217.24.81.215]) by mx1.freebsd.org (Postfix) with ESMTP id 811DB8FC16; Tue, 20 Dec 2011 16:12:07 +0000 (UTC) Received: from martymac.org (webmail.galacsys.net [217.24.81.215]) by data.galacsys.net (Postfix) with ESMTP id 4C5CF17134F; Tue, 20 Dec 2011 17:12:06 +0100 (CET) From: "Ganael LAPLANCHE" To: Andriy Gapon X-Openwebmail-Date: Tue, 20 Dec 2011 18:12:06 +0200 Message-Id: <20111220160753.M1352@martymac.org> In-Reply-To: <4EF0A3A7.80309@FreeBSD.org> References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> <20111220134716.M62917@martymac.org> <20111220142740.M29405@martymac.org> <4EF0A3A7.80309@FreeBSD.org> X-Mailer: Open WebMail 2.01 20030425 X-OriginatingIP: 157.99.64.43 (ganael.laplanche@martymac.org) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Date: Tue, 20 Dec 2011 17:12:06 +0100 (CET) Cc: Tijl Coosemans , freebsd-stable@FreeBSD.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 16:12:07 -0000 On Tue, 20 Dec 2011 17:03:03 +0200, Andriy Gapon wrote > Just a guess - this might be some sort of optimization to keep > virtual address range of dynamic allocations untouched by > unrelated mmap calls. Not sure if that's so and how useful > could that be. svn log / svn annotate of the file may reveal > more details. Mmmhh.... It seems that this part of the code is quite old and was already present in the BSD 4.4 Lite kernel (not exactly in the same shape, but with the same idea). Quite confusing... -- Ganael LAPLANCHE http://www.martymac.org | http://contribs.martymac.org FreeBSD: martymac , http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 16:33:43 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A34DD106564A for ; Tue, 20 Dec 2011 16:33:43 +0000 (UTC) (envelope-from k.joch@kmjeuro.com) Received: from sv06e.sbg.kmjeuro.com (sv06e.sbg.kmjeuro.com [178.188.116.22]) by mx1.freebsd.org (Postfix) with ESMTP id EA9B18FC16 for ; Tue, 20 Dec 2011 16:33:42 +0000 (UTC) Received: from sv06e.atm-tzs.kmjeuro.com (localhost [127.0.0.1]) by sv06e.sbg.kmjeuro.com (8.14.4/8.14.4) with ESMTP id pBKG08FJ087929 (version=TLSv1/SSLv3 cipher=DES-CBC3-SHA bits=168 verify=NOT) for ; Tue, 20 Dec 2011 17:00:08 +0100 (CET) (envelope-from k.joch@kmjeuro.com) Received: from [192.168.2.77] (account k.joch@kmjeuro.com) by sv06e.atm-tzs.kmjeuro.com (CommuniGate Pro IMAP 5.3.13 _community_) with XMIT id 3426248 for freebsd-stable@freebsd.org; Tue, 20 Dec 2011 17:00:08 +0100 Date: Tue, 20 Dec 2011 16:59:45 +0100 Message-Id: In-Reply-To: <4EF0A3A7.80309@FreeBSD.org> MIME-Version: 1.0 Thread-Topic: 8.2 Problem with creating Snapshots on large file systems? Cannot backup anymore. Priority: Normal Importance: normal X-MSMail-Priority: normal X-Priority: 3 Sensitivity: Normal Thread-Index: Acy/MGRYueo+kNWUSQan6u0dA8l36A== From: "Karl M. Joch" To: "freebsd-stable@freebsd.org" X-Mailer: CommuniGate Pro MAPI Connector 1.52.53.10/1.53.11.1 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-CTS-SV06-Mailserver-Information: please visit www.ctseuro.com for further instructions. Protected by www.ctseuro.com X-CTS-SV06-Mailserver-MailScanner-ID: pBKG08FJ087929 X-CTS-SV06-Mailserver: Found to be clean X-CTS-SV06-Mailserver-From: k.joch@kmjeuro.com CTS-MailScanner-Watermark: 1325001609.39418@syyToQyjf6/N4bCeFrNYKg Subject: 8.2 Problem with creating Snapshots on large file systems? Cannot backup anymore. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 16:33:43 -0000 Hi, since a few days i have trubles on one server when running the daily amanda= backup. This was running fine since over 6 Month and now dump, called by a= manda, always returns: FAIL dumper localhost.sbg.kmjeuro.com mirror/CTSs1d 20111219230324 0 [dump = (16603) /sbin/dump returned 1] sendbackup: start [localhost.sbg.kmjeuro.com:mirror/CTSs1d level 0] sendbackup: info BACKUP=3D/sbin/dump sendbackup: info RECOVER_CMD=3D/usr/bin/gzip -dc |/sbin/restore -xpGf - .= .. sendbackup: info COMPRESS_SUFFIX=3D.gz sendbackup: info end ? mksnap_ffs: Cannot create snapshot /usr/.snap/dump_snapshot: Resource t= emporarily unavailable | dump: Cannot create /usr/.snap/dump_snapshot: No such file or directory | ? dump (16603) /sbin/dump returned 1 sendbackup: error [dump (16603) /sbin/dump returned 1] and Amanda fails. System is: kern.ostype: FreeBSD kern.osrelease: 8.2-STABLE kern.osrevision: 199506 kern.version: FreeBSD 8.2-STABLE #1: Sun Mar 27 20:08:58 CEST 2011 FS: Filesystem Size Used Avail Capacity Mounted on /dev/mirror/CTSs1a 1.9G 362M 1.4G 20% / devfs 1.0K 1.0K 0B 100% /dev /dev/mirror/CTSs1f 4.8G 2.0M 4.5G 0% /tmp /dev/mirror/CTSs1d 969G 301G 590G 34% /usr /dev/mirror/CTSs1e 48G 2.3G 42G 5% /var /dev/mirror/CTSs1g 779G 4.5G 712G 1% /usr/l1 devfs 1.0K 1.0K 0B 100% /var/named/dev I tried alot of things meanwhile: - Powered of, running fsck -y in Single User Mode - Replaced one Harddisk which had some (recoverable) read errors and resync= ed gmirror - Googled alot and found some other posts with the same problem, but no rea= l answer. I want to stay with ufs2 and Amanda and dont want to switch to ZFS at the m= oment. I have some other Servers which does the same thing without any prob= lem, as this one has done it for month too. I prepared an rsync backup to o= ne of our NAS to have a temp backup but i need to have tapes soon again. An= y help or idea would be very appreciated. Thank you, Karl From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 17:21:55 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9A34A106567E for ; Tue, 20 Dec 2011 17:21:55 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) by mx1.freebsd.org (Postfix) with ESMTP id DFD5D8FC1B for ; Tue, 20 Dec 2011 17:21:54 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id pBKHLkQg019012; Wed, 21 Dec 2011 04:21:47 +1100 (EST) (envelope-from smithi@nimnet.asn.au) Date: Wed, 21 Dec 2011 04:21:45 +1100 (EST) From: Ian Smith To: Dominic Fandrey In-Reply-To: <4EF05F1A.6060504@bsdforen.de> Message-ID: <20111221002641.A64681@sola.nimnet.asn.au> References: <4EEAF70E.1040104@bsdforen.de> <20111217000216.Y64681@sola.nimnet.asn.au> <4EF05F1A.6060504@bsdforen.de> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-stable@freebsd.org, Oliver Pinter Subject: Re: battery display broken X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 17:21:55 -0000 On Tue, 20 Dec 2011 11:10:34 +0100, Dominic Fandrey wrote: > On 16/12/2011 16:28, Ian Smith wrote: > > On Fri, 16 Dec 2011, Dominic Fandrey wrote: > > > It seems something broke with the battery display. Last night it > > > showed 94% remaining capacity for more than 2 hours. > > > > > > Afterwards I docked the machine (HP6510b) and rebooted it. Since then > > > more than 8 hours have passed, but it still shows 16% (the LED > > indicators > > > state that the battery is full and no longer charging). > > > ... > > > > At least four things can go wrong. The battery charging circuit might > > be broken (my first T23 failed that way after 5 years); the battery > > might just need 'conditioning' (discharged to exhaustion, beyond normal > > low-battery shutdown, then fully charged - perhaps twice), to reset its > > internal Coulomb Counter; the CC chip may be faulty; or the battery > > itself may be failing / have failed, usually one cell first. > > The battery still does the expected 3 hours. That's about as much as I > can expect. Good! I suspected hardware because I've seen all of the above, and I'd seen no software problems with charging on FreeBSD {6,7,8}.x, so for the sake of your hardware I'm glad all that was irrelevant :) > > Is the battery hot at this stage? If that 'Present rate' is correct, a > > 3.35A/39.6W charge should tend to overheat the battery over time, if > > charging continues beyond full capacity, which may indicate a bad cell. > > Are you certain about that? Decent lithium cells can be charged with 6A > without becoming perceivably warmer. I'd expect that at least 39W of > the 39.6W get stored in the battery. Certain. High charge rates are fine for bulk capacity, but once full, continued charging will (must!) overheat the battery, and with LIion batteries, failure modes may include explosion and/or fierce fire. One recent local fire that completely consumed a house and sheds began just that way, unattended overcharging of large LIion batteries on an electric bicycle; I've yet to ask the poor guy what sort of charger it was, but any decent charge circuits monitor voltage, temperature and likely dV/dt at minimum - so please excuse my unwarranted concern :) Even with shorted cell/s, laptops monitor temperature too .. "Brand X laptop brings down jetliner" must be a manufacturer's worst nightmare. > > 11.8V seems too low for a fully-charged 10.8V nominal LIon battery. I > > have several 4.0 and 4.4Ah like the below, which charge to ~12.4V, and > > only get down to 11.8V while discharging, at around 85% nom. capacity. > > It states 16% capacity. Everything fits that. It simply doesn't update > the readings. When I boot with a charged battery: > Present voltage: 12540 mV Just so. This bug isn't hurting hardware, just messing with minds in this manifestation, while we wonder what other effect it may have? > > Interesting that your LEDs display a different view; perhaps BIOS + EC > > just monitors voltage and cuts charge, but then what's reporting that > > fairly high charge rate? I'd expect the Embedded Controller to be doing > > that .. any dmesg indications of ACPI problems talking to the EC? > > Well, that's interesting, it reports 2 batteries: > battery0: on acpi0 > battery1: on acpi0 > > I think there is an option for a second battery, but I'm certainly > not using it. acpiconf -i1 should report it as unavailable. > > The 16% is likely from the battery's onboard coulomb counter, but then > > so might be the (bogus?) charge rate report. All speculative, I know .. > > The data is all perfectly fine, it was simply from a moment in time > a couple hours in the past. It seems the reading is cached and never > updated. Obvious once known :) Curious to check acpiconf.c diffs 8.2 vs 9, I see only this latest change, which if I read it right, was in 8.2 anyway: http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.sbin/acpi/acpiconf/acpiconf.c.diff?r1=1.27;r2=1.28 and that shouldn't be pulling cached data, so maybe this issue is deeper in the ACPI/EC code? Well out of my depth, and no time to go diving now; anyway, another data point for kern/162859. > > All that said, I don't know specifically how HP do things, or what > > normal full charge voltage is expected. Tried another battery? > > Tried another OS. Windows shows the battery status just fine. > So did RELENG_8. This is a regression in RELENG_9 there isn't a > problem with the battery. Or if there is RELENG_8 was able to > cope. So it seems. When I get full backups done I'll brave bsdinstall again, but last time it wasn't happy to reuse my 7.4 slice's partitions without external newfs'ing, and I'm still hoping not to nuke its existing /home. cheers, Ian From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 17:24:16 2011 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 21CDF106566C for ; Tue, 20 Dec 2011 17:24:16 +0000 (UTC) (envelope-from linimon@lonesome.com) Received: from mail.soaustin.net (pancho.soaustin.net [76.74.250.40]) by mx1.freebsd.org (Postfix) with ESMTP id 035008FC0C for ; Tue, 20 Dec 2011 17:24:15 +0000 (UTC) Received: by mail.soaustin.net (Postfix, from userid 502) id 4CDC756173; Tue, 20 Dec 2011 11:06:48 -0600 (CST) Date: Tue, 20 Dec 2011 11:06:48 -0600 From: Mark Linimon To: stable@FreeBSD.org Message-ID: <20111220170648.GC10143@lonesome.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Cc: linimon@FreeBSD.org Subject: status of ports and clang X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 17:24:16 -0000 I have recently been able to get the new build cluster on pointyhat-west set up to run full builds of ports with clang on amd64-9. I have documented the latest results on the wiki: http://wiki.freebsd.org/PortsAndClang If you are interested in working on ports being built via clang, this is your place to start. Please also note that now that we have up-to-date builds going, it is not as useful to us to report individual clang build failures. Patches to fix problems are, of course, highly welcome. mcl From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 17:45:22 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D2194106567A for ; Tue, 20 Dec 2011 17:45:22 +0000 (UTC) (envelope-from tijl@coosemans.org) Received: from mailrelay011.isp.belgacom.be (mailrelay011.isp.belgacom.be [195.238.6.178]) by mx1.freebsd.org (Postfix) with ESMTP id 54FD48FC14 for ; Tue, 20 Dec 2011 17:45:21 +0000 (UTC) X-Belgacom-Dynamic: yes X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Av0EAJbI8E5bsVo6/2dsb2JhbABDq3+BBoFyAQEEAVUBIwULCxguOR4Zh3oCtyaIcoMaBKcw Received: from 58.90-177-91.adsl-dyn.isp.belgacom.be (HELO kalimero.tijl.coosemans.org) ([91.177.90.58]) by relay.skynet.be with ESMTP; 20 Dec 2011 18:45:19 +0100 Received: from kalimero.tijl.coosemans.org (kalimero.tijl.coosemans.org [127.0.0.1]) by kalimero.tijl.coosemans.org (8.14.5/8.14.5) with ESMTP id pBKHjHiY005162; Tue, 20 Dec 2011 18:45:18 +0100 (CET) (envelope-from tijl@coosemans.org) From: Tijl Coosemans To: freebsd-stable@freebsd.org Date: Tue, 20 Dec 2011 18:45:08 +0100 User-Agent: KMail/1.13.7 (FreeBSD/9.0-RC2; KDE/4.7.3; i386; ; ) References: <20111220080437.M63044@martymac.org> <20111220134716.M62917@martymac.org> <20111220142740.M29405@martymac.org> In-Reply-To: <20111220142740.M29405@martymac.org> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart2305471.X94DzsFhl4"; protocol="application/pgp-signature"; micalg=pgp-sha256 Content-Transfer-Encoding: 7bit Message-Id: <201112201845.15578.tijl@coosemans.org> Cc: Andriy Gapon , Ganael LAPLANCHE Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 17:45:22 -0000 --nextPart2305471.X94DzsFhl4 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: quoted-printable On Tuesday 20 December 2011 15:31:48 Ganael LAPLANCHE wrote: > On Tue, 20 Dec 2011 15:02:01 +0100 (CET), Ganael LAPLANCHE wrote >> But there is still something I don't understand : on the Linux >> machine where I ran my test program, the current RLIMIT_DATA >> is set to 0xffffffff/0xffffffff and I can manage to mmap at >> address 0x20000000. If I set the same limit on FreeBSD, I >> won't get the mapping at 0x20000000. So, there *is* a >> difference of behaviour between the two systems, but I don't >> understand why. >=20 > Well, in fact, two things remain not very clear for me : >=20 > - Why are mmap()s performed *after* data segment ? > =3D> It seems they can go within, on GNU/Linux and NetBSD. I don't know about NetBSD but Linux maps from the stack downwards when there's no hint and FreeBSD maps from the program upwards. That means that on Linux brk and mmap grow toward each other and unless you allocate a lot of memory they don't compete with each other. On FreeBSD brk and mmap do compete for the same space and this was resolved by preserving room for brk and moving mmap allocations further up. The case with hint lazily follows from that. Linux doesn't have any restrictions and FreeBSD preserves room for brk and moves the allocation up. > - Why do we have such a default value for datasize (8.2, amd64) : >=20 > $ limits > Resource limits (current): > cputime infinity secs > filesize infinity kB > datasize 33554432 kB >=20 > this is HUGE ! malloc(3) used to be implemented on top of brk(2) so the size was increased on amd64 so you could malloc more memory. Nowadays malloc can use mmap(2) so a large datasize isn't really needed anymore. > -- That should be "-- " (with space at the end). > Ganael LAPLANCHE > http://www.martymac.org | http://contribs.martymac.org > FreeBSD: martymac , http://www.FreeBSD.org --nextPart2305471.X94DzsFhl4 Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iF4EABEIAAYFAk7wyasACgkQfoCS2CCgtitabQD6Ayfas4afLznwteFfMw7eF/6B k+wSWCPpk37Tv6RrGdYA/iHew12MaB4/D/Pxe6riPrmXWcITn26mWnm0viVtvPP7 =CGLF -----END PGP SIGNATURE----- --nextPart2305471.X94DzsFhl4-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 17:49:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 32466106564A; Tue, 20 Dec 2011 17:49:35 +0000 (UTC) (envelope-from artemb@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id CE1AF8FC1D; Tue, 20 Dec 2011 17:49:34 +0000 (UTC) Received: by ghrr16 with SMTP id r16so1299428ghr.13 for ; Tue, 20 Dec 2011 09:49:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=/yB2BKZx/6e36AtZPwdSVN0mHcul88PgARujT7POimQ=; b=hujXdmjrSPOU4ibOa7+/ZYCaTpt9K+r5ga7wRU1z5uSCEqodBlHipIO4gtDkaGnZcd cBakuzfX+TEjrpXlWbldrFssOG1Y7v8cy4K1h1jBJw7SUzIsjl8b3uG+MZ5rq7Cj9de/ cFm7J4P1Lc+r4pC+DyUHh/zrT0Nt+xIP06Rho= MIME-Version: 1.0 Received: by 10.101.174.17 with SMTP id b17mr1580451anp.62.1324402063368; Tue, 20 Dec 2011 09:27:43 -0800 (PST) Sender: artemb@gmail.com Received: by 10.147.52.27 with HTTP; Tue, 20 Dec 2011 09:27:43 -0800 (PST) In-Reply-To: <4EF0A3A7.80309@FreeBSD.org> References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> <20111220134716.M62917@martymac.org> <20111220142740.M29405@martymac.org> <4EF0A3A7.80309@FreeBSD.org> Date: Tue, 20 Dec 2011 09:27:43 -0800 X-Google-Sender-Auth: WCmHePoeZAU9Qc9DnSZjgiU4TDo Message-ID: From: Artem Belevich To: Ganael LAPLANCHE Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Tijl Coosemans , freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 17:49:35 -0000 Hi, On Tue, Dec 20, 2011 at 7:03 AM, Andriy Gapon wrote: > on 20/12/2011 16:31 Ganael LAPLANCHE said the following: >> On Tue, 20 Dec 2011 15:02:01 +0100 (CET), Ganael LAPLANCHE wrote >> >>> But there is still something I don't understand : on the Linux >>> machine where I ran my test program, the current RLIMIT_DATA >>> is set to 0xffffffff/0xffffffff and I can manage to mmap at >>> address 0x20000000. If I set the same limit on FreeBSD, I >>> won't get the mapping at 0x20000000. So, there *is* a >>> difference of behaviour between the two systems, but I don't >>> understand why. >> >> Well, in fact, two things remain not very clear for me : >> >> - Why are mmap()s performed *after* data segment ? >> =A0 =3D> It seems they can go within, on GNU/Linux and NetBSD. >> >> - Why do we have such a default value for datasize (8.2, amd64) : >> >> $ limits >> Resource limits (current): >> =A0 cputime =A0 =A0 =A0 =A0 =A0 =A0 =A0infinity secs >> =A0 filesize =A0 =A0 =A0 =A0 =A0 =A0 infinity kB >> =A0 datasize =A0 =A0 =A0 =A0 =A0 =A0 33554432 kB >> >> this is HUGE ! > > Just a guess - this might be some sort of optimization to keep virtual ad= dress > range of dynamic allocations untouched by unrelated mmap calls. =A0Not su= re if > that's so and how useful could that be. Something like that. In the past heap allocator used to get memory from system via sbrk(). It still may do so, if you set MALLOC_OPTIONS=3DD. The problem is that sbrk() can't advance past an area used by something else (i.e. mmaped region) so kernel makes an effort to leave a lot of unused address space which sbrk() may claim later on. These days malloc() by default uses mmap, so if you don't force it to use sbrk() you can probably lower MAXDSIZE and let kernel use most of address space for hinted mmaps. That said, unless you use MAP_FIXED, malloc is not guaranteed to pay attention to hints and the app must be able to deal with that. FreeBSD kernel behavior is just one possible scenario that may affect mmap behavior. Behavior may also change between architectures, or due to preceeding mmaps (think of dynamic linker mapping in shared libraries). If an application relies on hints having effect without MAP_FIXED, it's the app that needs fixing, IMHO. --Artem > svn log / svn annotate of the file may reveal more details. > > -- > Andriy Gapon > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 18:30:36 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0CB4D106566B for ; Tue, 20 Dec 2011 18:30:36 +0000 (UTC) (envelope-from pho@holm.cc) Received: from relay00.pair.com (relay00.pair.com [209.68.5.9]) by mx1.freebsd.org (Postfix) with SMTP id B32C28FC1B for ; Tue, 20 Dec 2011 18:30:35 +0000 (UTC) Received: (qmail 82904 invoked from network); 20 Dec 2011 18:03:53 -0000 Received: from 87.58.144.241 (HELO x2.osted.lan) (87.58.144.241) by relay00.pair.com with SMTP; 20 Dec 2011 18:03:53 -0000 X-pair-Authenticated: 87.58.144.241 Received: from x2.osted.lan (localhost [127.0.0.1]) by x2.osted.lan (8.14.4/8.14.4) with ESMTP id pBKI3qF8058620; Tue, 20 Dec 2011 19:03:52 +0100 (CET) (envelope-from pho@x2.osted.lan) Received: (from pho@localhost) by x2.osted.lan (8.14.4/8.14.4/Submit) id pBKI3qAm058617; Tue, 20 Dec 2011 19:03:52 +0100 (CET) (envelope-from pho) Date: Tue, 20 Dec 2011 19:03:52 +0100 From: Peter Holm To: Kostik Belousov Message-ID: <20111220180352.GA58342@x2.osted.lan> References: <4EECFD6A.2030905@xs4all.nl> <2E07A04E-0FBF-47BE-96E7-F615FE78056E@gromit.dlib.vt.edu> <4EEFAC55.6050507@xs4all.nl> <20111219225143.GD2391@server.vk2pj.dyndns.org> <20111220094832.GL50300@deviant.kiev.zoral.com.ua> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111220094832.GL50300@deviant.kiev.zoral.com.ua> User-Agent: Mutt/1.4.2.3i Cc: Michiel Boland , freebsd-stable@freebsd.org, Peter Jeremy Subject: Re: fsck_ufs out of swapspace X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 18:30:36 -0000 On Tue, Dec 20, 2011 at 11:48:33AM +0200, Kostik Belousov wrote: > On Tue, Dec 20, 2011 at 09:51:43AM +1100, Peter Jeremy wrote: > > On 2011-Dec-19 22:27:49 +0100, Michiel Boland wrote: > > >Problem solved - it was indeed an endian thing. > > >The problem is that fsck uses a real_dev_bsize variable that is declared long, > > >but the DIOCGSECTORSIZE ioctl takes an u_int argument. > > > > To be accurate, this isn't an endian problem, it's a general problem > > of passing a pointer to an incorrectly sized object. The bug is > > masked on amd64 & iA64 because real_dev_bsize is statically allocated > > and therefore initialised to zero. This means the failure to assign > > the top 32 bits in the ioctl doesn't affect the final result. > > > > >A PR has been submitted. > > > > sparc64/163460 for the record. Thank you for tracking that down. > > The easier fix is to change the type of real_dev_bsize. I used long only > because other n variables keeping the sector size are long, but there > is no much reason to use long there. > > Peter, would you, please retest the +J on non-512 byte sectors, with the > patch attached ? > No problems seen while testing on both i386 and amd64 with a malloc MD disk, sector size of 4k and SUJ. - Peter From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 19:13:22 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DDD0E1065676 for ; Tue, 20 Dec 2011 19:13:22 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from mail.vx.sk (mail.vx.sk [IPv6:2a01:4f8:150:6101::4]) by mx1.freebsd.org (Postfix) with ESMTP id 76FAA8FC23 for ; Tue, 20 Dec 2011 19:13:22 +0000 (UTC) Received: from core.vx.sk (localhost [127.0.0.2]) by mail.vx.sk (Postfix) with ESMTP id A9FB8192C3; Tue, 20 Dec 2011 20:13:21 +0100 (CET) X-Virus-Scanned: amavisd-new at mail.vx.sk Received: from mail.vx.sk by core.vx.sk (amavisd-new, unix socket) with LMTP id 6q9N7n6JYd25; Tue, 20 Dec 2011 20:13:19 +0100 (CET) Received: from [10.9.8.1] (188-167-78-15.dynamic.chello.sk [188.167.78.15]) by mail.vx.sk (Postfix) with ESMTPSA id 411D8192B2; Tue, 20 Dec 2011 20:13:19 +0100 (CET) Message-ID: <4EF0DE4E.3040108@FreeBSD.org> Date: Tue, 20 Dec 2011 20:13:18 +0100 From: Martin Matuska User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Patrick Lamaiziere References: <20111220164148.4293d21c@mr129166> In-Reply-To: <20111220164148.4293d21c@mr129166> X-Enigmail-Version: 1.3.4 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Cc: FreeBSD Stable Mailing List Subject: Re: [9.0-RC3] tar xf with zip archive is broken X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 19:13:23 -0000 On 20.12.2011 16:41, Patrick Lamaiziere wrote: > Hello, > > Looks like tar -xf with zip archive is broken on 9.0. It creates the > directories but files are empty. > > See with nagios-checker firefox plugin (.xpi which is a zip file) > http://code.google.com/p/nagioschecker/downloads/detail?name=nagioschecker-0.16.xpi&can=2&q= > > total 20 > drwxr-xr-x 4 patrick patrick 6 20 déc 16:35 ./ > drwxr-xr-x 43 patrick patrick 89 20 déc 16:34 ../ > drwxr-xr-x 3 patrick patrick 3 20 déc 16:35 chrome/ > -rwxr-xr-x 1 patrick patrick 0 15 déc 2010 chrome.manifest* > drwxr-xr-x 3 patrick patrick 3 20 déc 16:35 defaults/ > -rwxr-xr-x 1 patrick patrick 0 31 déc 2010 install.rdf* > > On 8.2 that works fine. > > Regards. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" This is a libarchive bug. Fixed in upstream r3723: http://code.google.com/p/libarchive/source/detail?r=3723 I am preparing a libarchive update to 2.8.5 + recent SVN bugfixes. This won't make it to 9.0, though. -- Martin Matuska FreeBSD committer http://blog.vx.sk From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 20:48:14 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0D4EC106564A; Tue, 20 Dec 2011 20:48:14 +0000 (UTC) (envelope-from mozolevsky@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id BFA2C8FC1A; Tue, 20 Dec 2011 20:48:13 +0000 (UTC) Received: by pbcc3 with SMTP id c3so5312078pbc.13 for ; Tue, 20 Dec 2011 12:48:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type; bh=/CaEm1Px9Ljrz2CxJ7e4Ko5mcSwakpZcL4rqV3nij4w=; b=WUGe0HQf5q8d5HsXXUv7p7CZiDfulGL/J15RyvgOb+XcguAgWqrHEPNkyE5k9vk+rJ PYyA6UmVhYcuyVD2nC1OFMj9IdocI0SZCEb/HEUTdt5Ex7YBDOfnu1k2pSBnJg48KMGn J4XcYq6WKyd+BnYlYWruu3OSFmtNVrpRGjjPg= Received: by 10.68.74.98 with SMTP id s2mr5591159pbv.46.1324412493178; Tue, 20 Dec 2011 12:21:33 -0800 (PST) MIME-Version: 1.0 Sender: mozolevsky@gmail.com Received: by 10.68.51.133 with HTTP; Tue, 20 Dec 2011 12:20:52 -0800 (PST) In-Reply-To: <4EE9A2A0.80607@zedat.fu-berlin.de> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> From: Igor Mozolevsky Date: Tue, 20 Dec 2011 20:20:52 +0000 X-Google-Sender-Auth: sq1TBiXB5HA-vy4_GqUuXWzzqyM Message-ID: To: "O. Hartmann" Content-Type: text/plain; charset=UTF-8 Cc: freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 20:48:14 -0000 Interestingly, while people seem to be (arguably rightly) focused on criticising Phoronix's benchmarking, nobody has offered an alternative benchmark; and while (again, arguably rightly) it is important to benchmark real world performance, equally, nobody has offered any numbers in relation to, for example, HTTP or SMTP, or any other "real world"-application torture tests done on the aforementioned two platforms... IMO, this just goes to show that "doing is hard" and "criticising is much easier" (yes, I am aware of the irony involved in making this statement, but someone has to!) Cheers, Igor M :-) From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 21:39:24 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 60458106566B; Tue, 20 Dec 2011 21:39:24 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 02F7F8FC17; Tue, 20 Dec 2011 21:39:23 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Rd7P8-0003XO-F9>; Tue, 20 Dec 2011 22:39:22 +0100 Received: from e178016253.adsl.alicedsl.de ([85.178.16.253] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Rd7P8-0004Ye-9D>; Tue, 20 Dec 2011 22:39:22 +0100 Message-ID: <4EF10088.1010409@zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 22:39:20 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Igor Mozolevsky References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> In-Reply-To: X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8C1553888582332653719232" X-Originating-IP: 85.178.16.253 Cc: freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 21:39:24 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8C1553888582332653719232 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 12/20/11 21:20, Igor Mozolevsky wrote: > Interestingly, while people seem to be (arguably rightly) focused on > criticising Phoronix's benchmarking, nobody has offered an alternative > benchmark; and while (again, arguably rightly) it is important to > benchmark real world performance, equally, nobody has offered any > numbers in relation to, for example, HTTP or SMTP, or any other "real > world"-application torture tests done on the aforementioned two > platforms... IMO, this just goes to show that "doing is hard" and > "criticising is much easier" (yes, I am aware of the irony involved in > making this statement, but someone has to!) >=20 >=20 > Cheers, > Igor M :-) Unfortunately, M. Larabel is the only one who's performing benchmarks on FreeBSD, comparing its performance to the Linux-opponents. Adn indeed, there is a lot of criticism, but no alternative. I said unfortunately - not offensive - since Larabel and Phoronix are sadly the only ones who do actually such bechmarking. It would be much more nicer and kind to support those people. Well, in January/February we get new hardware. One box is supposed to do number crunching via 12 cores and a TESLA GPU. My colleague is developing a high parallelized peice of software for satellite data transformation. The software package is CPU bound, partially GPU, but massively memory hungry (96 to 128 GB RAM is needed). What I can offer is, since I will also work on that machine and I've free hand to administer, in the spare time of doing my PhD, installing FreeBSD 9.0/10.0 besides SuSe Linux and looking forward having one ZFS data storage drive for homes, so both systems can perform on a most recent ZFS. I'm new to Linux, not a BSD guru, nor I'm a professional programmer/developer. My skills are sufficient for the daily scientific work. So, without pressure, I'm willing to perform some HPC benchmarks under advice if the day comes and those interested in bare numbers of FreeBSD vs. Linux performance with a real-world-scientific application. I would appreciate to see some of the developers and/or FreeBSD hackers to help Phoronix setting up a proper testenvironment instead of bashing M. Larabel and his fellows. Regards, Oliver --------------enig8C1553888582332653719232 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO8QCJAAoJEOgBcD7A/5N8EoQIAMj9hcl5dL2gB5V7lkebJIWI hrxXPCISgYoRq3nLa/YbH+Ub532VB4t6ftfI+C6UE5/3/NBFujnI9My5bV9Xnys6 +yUbzdxY7t9SRujf8rhg8JpwwgUySwhMa4v9pnefUML9Pi+fN2U35ZjDCWFbFlpS IRfcsueq4OgKr9PWa06eeZmlbp2AYoKsnlV+bM1TvI4pDAvpqgHkzci526h/TzAc gbPhw+Wjn/JvH7ZWxKnF3pG8U+zAuOSI0g7JC6wy59O71UJEpEiEVwAvmv/dFDgx 61GvOy0cZ/zLMkN0ag7D8Zy/1byNnaIa7Rli42bJV8Ho3SRp7joYrBryf2L3J2Q= =6hh+ -----END PGP SIGNATURE----- --------------enig8C1553888582332653719232-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 21:45:54 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8AC21065670; Tue, 20 Dec 2011 21:45:54 +0000 (UTC) (envelope-from sjg@evilcode.net) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 5863C8FC19; Tue, 20 Dec 2011 21:45:54 +0000 (UTC) Received: by qcse13 with SMTP id e13so5904734qcs.13 for ; Tue, 20 Dec 2011 13:45:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.224.205.134 with SMTP id fq6mr5166209qab.99.1324417553722; Tue, 20 Dec 2011 13:45:53 -0800 (PST) Received: by 10.229.6.142 with HTTP; Tue, 20 Dec 2011 13:45:53 -0800 (PST) In-Reply-To: References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 14:45:53 -0700 Message-ID: From: "Samuel J. Greear" To: Igor Mozolevsky Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: FreeBSD Stable Mailing List , freebsd-performance@freebsd.org, Current FreeBSD , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 21:45:55 -0000 http://www.osnews.com/story/25334/DragonFly_BSD_MP_Performance_Significantly_Improved PostgreSQL tests, see the linked PDF for #'s on FreeBSD, DragonFly, Linux and Solaris. Steps to reproduce these benchmarks provided. Sam On Tue, Dec 20, 2011 at 1:20 PM, Igor Mozolevsky wrote: > Interestingly, while people seem to be (arguably rightly) focused on > criticising Phoronix's benchmarking, nobody has offered an alternative > benchmark; and while (again, arguably rightly) it is important to > benchmark real world performance, equally, nobody has offered any > numbers in relation to, for example, HTTP or SMTP, or any other "real > world"-application torture tests done on the aforementioned two > platforms... IMO, this just goes to show that "doing is hard" and > "criticising is much easier" (yes, I am aware of the irony involved in > making this statement, but someone has to!) > > > Cheers, > Igor M :-) > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 22:54:26 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFA5A106566B; Tue, 20 Dec 2011 22:54:26 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 81BE08FC08; Tue, 20 Dec 2011 22:54:26 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Rd8Zl-0002HE-1k>; Tue, 20 Dec 2011 23:54:25 +0100 Received: from e178016253.adsl.alicedsl.de ([85.178.16.253] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Rd8Zk-0008C4-Pd>; Tue, 20 Dec 2011 23:54:25 +0100 Message-ID: <4EF1121F.9010209@zedat.fu-berlin.de> Date: Tue, 20 Dec 2011 23:54:23 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: "Samuel J. Greear" References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> In-Reply-To: X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigB1D490B63A11258175672D7F" X-Originating-IP: 85.178.16.253 Cc: freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , Jeremy Chadwick , Igor Mozolevsky Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 22:54:27 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigB1D490B63A11258175672D7F Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/20/11 22:45, Samuel J. Greear wrote: > http://www.osnews.com/story/25334/DragonFly_BSD_MP_Performance_Signific= antly_Improved >=20 > PostgreSQL tests, see the linked PDF for #'s on FreeBSD, DragonFly, Lin= ux > and Solaris. Steps to reproduce these benchmarks provided. >=20 > Sam >=20 > On Tue, Dec 20, 2011 at 1:20 PM, Igor Mozolevsky wrote: >=20 >> Interestingly, while people seem to be (arguably rightly) focused on >> criticising Phoronix's benchmarking, nobody has offered an alternative= >> benchmark; and while (again, arguably rightly) it is important to >> benchmark real world performance, equally, nobody has offered any >> numbers in relation to, for example, HTTP or SMTP, or any other "real >> world"-application torture tests done on the aforementioned two >> platforms... IMO, this just goes to show that "doing is hard" and >> "criticising is much easier" (yes, I am aware of the irony involved in= >> making this statement, but someone has to!) >> >> >> Cheers, >> Igor M :-) >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.= org" >> Thanks for those numbers. Impressive how Matthew Dillon's project jumps forward now. And it is still impressive to see that the picture is still in the right place when it comes to a comparison to Linux. Also, OpenIndiana shows an impressive performance. But this is only one suite of testing. Scientific Linux is supposed to give the best performance for scientifi purposes, i.e. for longhaul calculations, much numerical stuff. It outperforms in a typical server application FreeBSd, were "FreeBSD shoulkd have the power to serve". Is the postgresql benchmark the only way to benchmark? Well, this inspires me to gather together all the benchmarks someone could find. There were lots of compalins about FreeBSD's poor performance with BIND - once a domain of FreeBSD. Network performance seems also to be an issue if it comes to scalability. It would be nice to see what portion of the raw CPU/GPU power the OS (FreeBSD, Linux ...) delivers to scientific applications. I only know some kind of benchmarks, BYTE UNIX benchmark, LINPACK test =2E.. Does someone know a site to look for a couple of benchmarks to test= a) memory system b) scalability (apart from pgbench) c) network performance/throughput/network scalability d) portion of CPU performance the system delivers for numerical applications to the user apart from the system's own consumption e) disk I/O performance and scalability it would also be nice to discuss some nice settings and performance tunings for FreeBSD for several scenarios. I guess, starting developing benchmarking test scenarios for several purposes would lead faster to real numbers and non polemic than weird discussions ... --------------enigB1D490B63A11258175672D7F Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO8RIfAAoJEOgBcD7A/5N8dhQIANomh6qezYWsQVSYv3QYaLQR /ooQAaxCODCdunq3ZGmDl41YH3UTUvmOTpUoxTgSCeiycMRQW74DGm7mYHDb72hY 6PaxU2c5Ehh9bFT7TUsolZFHY0xHysHcQCpu9tqoj5hvuXAAZG6SO7PUxTDDyjAc VgWGaX3iYF0W3H1dNqYz4970Z1E1Zhb4X2rFvWkpPYEqinvNbwsz3YImeLCCVNVL r+nru3JMwwnu1XUSd7InYySbQFGW42YQ5hXwvc84NzbCR+pMGL3LYh9QIaZMlVtQ vgFjvMOSPWLCjJepq5jrMg7EiYUIRnTqVHDOJe4WgXxPzuzQq+s7UaMwEcabtWU= =8iuY -----END PGP SIGNATURE----- --------------enigB1D490B63A11258175672D7F-- From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 23:29:29 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4453C106566B for ; Tue, 20 Dec 2011 23:29:29 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta03.westchester.pa.mail.comcast.net (qmta03.westchester.pa.mail.comcast.net [76.96.62.32]) by mx1.freebsd.org (Postfix) with ESMTP id D1EF08FC13 for ; Tue, 20 Dec 2011 23:29:28 +0000 (UTC) Received: from omta17.westchester.pa.mail.comcast.net ([76.96.62.89]) by qmta03.westchester.pa.mail.comcast.net with comcast id BZqZ1i0021vXlb853bVUAr; Tue, 20 Dec 2011 23:29:28 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta17.westchester.pa.mail.comcast.net with comcast id BbVT1i00c1t3BNj3dbVTkp; Tue, 20 Dec 2011 23:29:28 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id DAF21102C19; Tue, 20 Dec 2011 15:29:25 -0800 (PST) Date: Tue, 20 Dec 2011 15:29:25 -0800 From: Jeremy Chadwick To: "O. Hartmann" Message-ID: <20111220232925.GA55953@icarus.home.lan> References: <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF1121F.9010209@zedat.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF1121F.9010209@zedat.fu-berlin.de> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD Stable Mailing List , freebsd-performance@freebsd.org, Current FreeBSD , "Samuel J. Greear" , Igor Mozolevsky Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 23:29:29 -0000 On Tue, Dec 20, 2011 at 11:54:23PM +0100, O. Hartmann wrote: > On 12/20/11 22:45, Samuel J. Greear wrote: > > http://www.osnews.com/story/25334/DragonFly_BSD_MP_Performance_Significantly_Improved > > > > PostgreSQL tests, see the linked PDF for #'s on FreeBSD, DragonFly, Linux > > and Solaris. Steps to reproduce these benchmarks provided. > > > > Sam > > > > On Tue, Dec 20, 2011 at 1:20 PM, Igor Mozolevsky wrote: > > > >> Interestingly, while people seem to be (arguably rightly) focused on > >> criticising Phoronix's benchmarking, nobody has offered an alternative > >> benchmark; and while (again, arguably rightly) it is important to > >> benchmark real world performance, equally, nobody has offered any > >> numbers in relation to, for example, HTTP or SMTP, or any other "real > >> world"-application torture tests done on the aforementioned two > >> platforms... IMO, this just goes to show that "doing is hard" and > >> "criticising is much easier" (yes, I am aware of the irony involved in > >> making this statement, but someone has to!) > >> > >> > >> Cheers, > >> Igor M :-) > >> _______________________________________________ > >> freebsd-current@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-current > >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > >> > > Thanks for those numbers. > Impressive how Matthew Dillon's project jumps forward now. And it is > still impressive to see that the picture is still in the right place > when it comes to a comparison to Linux. > Also, OpenIndiana shows an impressive performance. Preface to my long post below: The things being discussed here are benchmarks, as in "how much work can you get out of Thing". This is VERY DIFFERENT from testing interactivity in a scheduler, which is more of a test that says "when Thing X is executed while heavier-Thing Y is also being executed, how much interaction is lost in Thing X". The reason people notice this when using Xorg is because it's visual, in an environment where responsiveness is absolutely mandatory above all else. Nobody is going to put up with a system where during a buildworld they go to move a window or click a mouse button or type a key and find that the window doesn't move, the mouse click is lost, or the key typed has gone into the bit bucket -- or, that those things are SEVERELY delayed, to the point where interactivity is crap. I just want to make that clear to folks. This immense thread has been with regards to the latter -- bad interactivity/responsiveness on a system which was undergoing load that SHOULD be distributed "more evenly" across the system *while* keeping interactivity/responsiveness high. Historically nice/renice has been used for this task, but that was when kernels were a little less complex and I/O subsystems were less complex. Remember: we've now got schedulers for each type of thing, and who gets what priority? You get my point I'm sure. So remember: this was to discuss that aspect, with regards to ULE vs. 4BSD schedulers. Now, back to the benchmarks: This also interested me: * Linux system crashed http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00008.html * OpenIndiana system crashed same way as Linux system http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00017.html I cannot help but wonder if the Linux and OpenIndiana installations were more stressful on the hardware -- getting more out of the system, maybe resulting in increased power/load, which in turn resulted in the systems locking up (shoddy PSU, unstable mainboard, MCH problems, etc.). My point is that Francois states these things in such a way to imply that "DragonflyBSD was more stable", when in fact I happen to wonder the opposite point -- that is to say, Linux and OpenIndiana were trying to use the hardware more-so than DragonflyBSD, thus tickled what may be a hardware-level problem. > But this is only one suite of testing. Scientific Linux is supposed to > give the best performance for scientifi purposes, i.e. for longhaul > calculations, much numerical stuff. It outperforms in a typical server > application FreeBSd, were "FreeBSD shoulkd have the power to serve". > > Is the postgresql benchmark the only way to benchmark? I sure hope not. But you know what's equally as interesting? This: http://people.freebsd.org/~kris/scaling/ Specifically circa 2008: http://people.freebsd.org/~kris/scaling/4cpu-pgsql.png http://people.freebsd.org/~kris/scaling/pgsql-16cpu-2.png http://people.freebsd.org/~kris/scaling/pgsql-16cpu.png Now, I don't know if what was used in those ("pgsql sysbench") was the same thing as "pg_bench" in the DragonflyBSD tests, but if so, the numbers are different to a point that is preposterous. There's also this: http://people.freebsd.org/~kris/scaling/pgsql-ncpu.png Now, compare those numbers to the TPS numbers shown here: http://dl.wolfpond.org/Pg-benchmarks.pdf So um... yeah. Now, if someone here is going to say "well, what was tested by Kris was FreeBSD 7.0, while what was tested by Francois was FreeBSD 9.0, and there have been improvements", then I ask that someone show me where the improvements are that would exhibit a 4-8x performance increase in some cases. This rambling of mine is the same rambling I posted earlier in this thread. There needs to be a consistent, standardised way of testing this stuff. Every system tested tuned the exact same way, software configured the same way, absolutely no quirks applied, etc.. Otherwise we end up with "mixed results" as shown above. Much to the disapproval of others, the Phoronix test suite is supposed to be that "standard". Meaning, it's a suite you're supposed to be able to install and thus ensures that, aside from compiler used and any system tests, that the same code is being used regardless of what system and OS it's on. Have I ever used it? No. And it's important that I admit that up front, because being honest is necessary. > Well, this inspires me to gather together all the benchmarks someone > could find. There were lots of compalins about FreeBSD's poor > performance with BIND - once a domain of FreeBSD. Network performance > seems also to be an issue if it comes to scalability. > It would be nice to see what portion of the raw CPU/GPU power the OS > (FreeBSD, Linux ...) delivers to scientific applications. Kris Kenneway's "BIND benchmark" that was released a long time ago touched base on this. Remember: these plots show nothing other than number of queries per second correlated with number of DNS server threads (since BIND does have a 1:1 thread-to-CPU creation ratio): http://people.freebsd.org/~kris/scaling/bind-pt.png http://people.freebsd.org/~kris/scaling/bind-pt-2.png http://people.freebsd.org/~kris/scaling/bind-pt-gige.png > I only know some kind of benchmarks, BYTE UNIX benchmark, LINPACK test > ... Does someone know a site to look for a couple of benchmarks to test > > a) memory system > b) scalability (apart from pgbench) > c) network performance/throughput/network scalability > d) portion of CPU performance the system delivers for numerical > applications to the user apart from the system's own consumption > e) disk I/O performance and scalability > > it would also be nice to discuss some nice settings and performance > tunings for FreeBSD for several scenarios. I guess, starting developing > benchmarking test scenarios for several purposes would lead faster to > real numbers and non polemic than weird discussions ... All I wish is that we had some kind of "test suite" of our own, maybe as a port, maybe in the base system, which could really help with all of this. Something consistent. Now I'm switching back to discussing interactivity/responsiveness tests: Attilio Rao did comment in this thread to me, giving me some test methodologies for testing interactivity during two types of simultaneous loads -- but one involves dnetc, which I imagine means I'd need to get familiar with that whole thing. http://lists.freebsd.org/pipermail/freebsd-stable/2011-December/064936.html I haven't responded to his post yet (this thread is so long and tedious that I'm having serious problems following it + remembering all the details -- am I the only one who feels daunted by this? God I hope not), but his insights are, as always, beneficial, but also overwhelming. Furthermore, I do not have 16-core or 24-core systems to test on -- I have single-CPU, quad-core and dual-core systems to test on. I am a firm believer these are going to make up the majority of the FreeBSD userbase (desktop and server environments). Extreme hardware (e.g. quad CPU with 12 cores per CPU) can be tested too, but let's at least pick a demographic to start with. Again: the FreeBSD users and administrative community want to help. All of us do. We just need to know exactly what we should be doing to test, and what exactly we're testing for. I'll be blunt while choosing to play the Idiot Admin for a moment: I'd be much happier if someone had a tarball of shell scripts and things which could be used to test these things. Lots of things need to be kept in mind, such as if someone is running the "client" test on the same box as the "server" test, and things like "the test data is written to a local filesystem, with echo/printf statements constantly flushed" (great, now we're causing I/O load on top of our tests!), which to me means we should probably be using something like mdconfig(8) to create a temporary filesystem to store logs/data results. The KTR stuff Atillio and many others have requested, I think, will be the most beneficial way to get the developers the data they need. I had no idea about it until I found out that KTR was something completely different than ktrace. I still haven't found the time to do all of this, BTW, and for that I apologise. The reason has to do with time at work + personal desire to do it. When I get a daunting task, I tend to get... well, not depressed, but "scared" of the massive undertaking since it involves lots of recurring tests, reboots, etc. -- hours of work -- and if I get that wrong, it's wasted effort (thus wasted developer time). I want to get it right. :-) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Tue Dec 20 23:33:49 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 780C71065670; Tue, 20 Dec 2011 23:33:49 +0000 (UTC) (envelope-from matthew@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 3AEA18FC12; Tue, 20 Dec 2011 23:33:48 +0000 (UTC) Received: from palm-64-28-152-131.palm.com ([64.28.152.131] helo=LT740055CZ0L1.palm1.palmone.com) by phx1.phoronix.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1Rd9Bq-000144-UL; Tue, 20 Dec 2011 17:33:46 -0600 Message-ID: <4EF11B57.7090007@phoronix.com> Date: Tue, 20 Dec 2011 15:33:43 -0800 From: Matthew Tippett User-Agent: Mozilla/5.0 (X11; Linux i686; rv:9.0) Gecko/20111214 Thunderbird/9.0 MIME-Version: 1.0 To: "O. Hartmann" References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF1121F.9010209@zedat.fu-berlin.de> In-Reply-To: <4EF1121F.9010209@zedat.fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Cc: FreeBSD Stable Mailing List , Current FreeBSD , Igor Mozolevsky , "Samuel J. Greear" , freebsd-performance@freebsd.org, Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Dec 2011 23:33:49 -0000 Bottom post this time to follow Oliver :). On 12/20/2011 02:54 PM, O. Hartmann wrote: > On 12/20/11 22:45, Samuel J. Greear wrote: >> http://www.osnews.com/story/25334/DragonFly_BSD_MP_Performance_Significantly_Improved >> >> PostgreSQL tests, see the linked PDF for #'s on FreeBSD, DragonFly, Linux >> and Solaris. Steps to reproduce these benchmarks provided. >> >> Sam There are still possible issues with those benchmarks. The Xeon has known problems scaling from 6 to 12 cores (well enabling the hyperthreading), so you may find that some platforms are penalized in performance if HT is turned on. See the scaling that Phoronix has done in http://openbenchmarking.org/result/1112166-AR-1112153AR03 Most systems are good with scaling on real cores, the hyperthreading (and for that matter the Bulldozer thread affinity) can really break performance. Different platforms have different behaviours. Benchmarking is a mucky business.. Note that the benchmarks with Phoronix test suite are repeatable, once installed, you can just run "./phoronix-test-suite benchmark 1112113-AR-ORACLELIN37" to repeat (as close as the system allows) the benchmarks that started this thread. >> Is the postgresql benchmark the only way to benchmark? pgbench is already included in the Phoronix Test Suite (at least 9.0.1 TPC-B benchmark. >> >> Well, this inspires me to gather together all the benchmarks someone >> could find. There were lots of compalins about FreeBSD's poor >> performance with BIND - once a domain of FreeBSD. Network performance >> seems also to be an issue if it comes to scalability. >> It would be nice to see what portion of the raw CPU/GPU power the OS >> (FreeBSD, Linux ...) delivers to scientific applications. >> >> I only know some kind of benchmarks, BYTE UNIX benchmark, LINPACK test >> ... Does someone know a site to look for a couple of benchmarks to test >> >> a) memory system >> b) scalability (apart from pgbench) >> c) network performance/throughput/network scalability >> d) portion of CPU performance the system delivers for numerical >> applications to the user apart from the system's own consumption >> e) disk I/O performance and scalability The majority of these benchmarks are already in Phoronix Test Suite. There is monitoring capability (temp, load, CPU states, etc). The question is the mapping from system attribute to benchmark, as well as determine what the ambigious terms mean (scaling can mean on increasing workloads, as memory is increased, as cpus are increased). >> >> it would also be nice to discuss some nice settings and performance >> tunings for FreeBSD for several scenarios. I guess, starting developing >> benchmarking test scenarios for several purposes would lead faster to >> real numbers and non polemic than weird discussions ... >> This is what Michael and I are wanting to see. Adrian Chadd has offerered to help facilitate within the FreeBSD community. As mentioned before, what I'd like to see is 1) Recommendations for more rounded benchmarks from the FreeBSD perspective 2) Tuning guide documented somewhere within the community 3) Comparative results based on the communities testing. All concrete, and all achievable. Regards, Matthew From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 00:28:08 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 239181065670; Wed, 21 Dec 2011 00:28:08 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 8E64C8FC0C; Wed, 21 Dec 2011 00:28:07 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RdA2Q-0002E4-Ou>; Wed, 21 Dec 2011 01:28:06 +0100 Received: from e178016253.adsl.alicedsl.de ([85.178.16.253] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RdA2Q-0003rz-DI>; Wed, 21 Dec 2011 01:28:06 +0100 Message-ID: <4EF12815.2090805@zedat.fu-berlin.de> Date: Wed, 21 Dec 2011 01:28:05 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111109 Thunderbird/8.0 MIME-Version: 1.0 To: Jeremy Chadwick References: <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF1121F.9010209@zedat.fu-berlin.de> <20111220232925.GA55953@icarus.home.lan> In-Reply-To: <20111220232925.GA55953@icarus.home.lan> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig3B0CE417BCECAA1895E10BDC" X-Originating-IP: 85.178.16.253 Cc: "Samuel J. Greear" , freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , Igor Mozolevsky Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 00:28:08 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig3B0CE417BCECAA1895E10BDC Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/21/11 00:29, Jeremy Chadwick wrote: > On Tue, Dec 20, 2011 at 11:54:23PM +0100, O. Hartmann wrote: >> On 12/20/11 22:45, Samuel J. Greear wrote: >>> http://www.osnews.com/story/25334/DragonFly_BSD_MP_Performance_Signif= icantly_Improved >>> >>> PostgreSQL tests, see the linked PDF for #'s on FreeBSD, DragonFly, L= inux >>> and Solaris. Steps to reproduce these benchmarks provided. >>> >>> Sam >>> >>> On Tue, Dec 20, 2011 at 1:20 PM, Igor Mozolevsky wrote: >>> >>>> Interestingly, while people seem to be (arguably rightly) focused on= >>>> criticising Phoronix's benchmarking, nobody has offered an alternati= ve >>>> benchmark; and while (again, arguably rightly) it is important to >>>> benchmark real world performance, equally, nobody has offered any >>>> numbers in relation to, for example, HTTP or SMTP, or any other "rea= l >>>> world"-application torture tests done on the aforementioned two >>>> platforms... IMO, this just goes to show that "doing is hard" and >>>> "criticising is much easier" (yes, I am aware of the irony involved = in >>>> making this statement, but someone has to!) >>>> >>>> >>>> Cheers, >>>> Igor M :-) >>>> _______________________________________________ >>>> freebsd-current@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-current >>>> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebs= d.org" >>>> >> >> Thanks for those numbers. >> Impressive how Matthew Dillon's project jumps forward now. And it is >> still impressive to see that the picture is still in the right place >> when it comes to a comparison to Linux. >> Also, OpenIndiana shows an impressive performance. >=20 > Preface to my long post below: >=20 > The things being discussed here are benchmarks, as in "how much work > can you get out of Thing". This is VERY DIFFERENT from testing > interactivity in a scheduler, which is more of a test that says "when > Thing X is executed while heavier-Thing Y is also being executed, how > much interaction is lost in Thing X". >=20 > The reason people notice this when using Xorg is because it's visual, > in an environment where responsiveness is absolutely mandatory above al= l > else. Nobody is going to put up with a system where during a buildworl= d > they go to move a window or click a mouse button or type a key and find= > that the window doesn't move, the mouse click is lost, or the key typed= > has gone into the bit bucket -- or, that those things are SEVERELY > delayed, to the point where interactivity is crap. I whitnessed sticky, jumpy and non-responsive-for seconds FreeBSD servers (serving homes, NFS/SAMBA and PostgreSQL database (small)). Those "seconds" where enough to cut a ssh line. Not funny. Network traffic droped significantly. X/Desktop makes the problem visible, indeed. But not seeing it does not mean it isn't there. This might be the reason why FreeBSD is so much behind when it comes to X= ? >=20 > I just want to make that clear to folks. This immense thread has been > with regards to the latter -- bad interactivity/responsiveness on a > system which was undergoing load that SHOULD be distributed "more > evenly" across the system *while* keeping interactivity/responsiveness > high. Historically nice/renice has been used for this task, but that > was when kernels were a little less complex and I/O subsystems were les= s > complex. Remember: we've now got schedulers for each type of thing, > and who gets what priority? You get my point I'm sure. >=20 > So remember: this was to discuss that aspect, with regards to ULE vs. > 4BSD schedulers. >=20 > Now, back to the benchmarks: >=20 > This also interested me: >=20 > * Linux system crashed > http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00008.html= >=20 > * OpenIndiana system crashed same way as Linux system > http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00017.html= >=20 > I cannot help but wonder if the Linux and OpenIndiana installations wer= e > more stressful on the hardware -- getting more out of the system, maybe= > resulting in increased power/load, which in turn resulted in the system= s > locking up (shoddy PSU, unstable mainboard, MCH problems, etc.). Is FreeBSD supposed to run on dumpyard equipment? In former times, freeBSD was used on high value hardware, not the decomissioned crap with shoddy PSUs or whatsoever. If I need a server, I care about quality hardware as I do for my lab's box and my own box at home. I expect a "server garde" hardware to act like that and I expect the operating system to get the maximum out of that hardware. Otherwise it is not worth one shot. >=20 > My point is that Francois states these things in such a way to imply > that "DragonflyBSD was more stable", when in fact I happen to wonder th= e > opposite point -- that is to say, Linux and OpenIndiana were trying to > use the hardware more-so than DragonflyBSD, thus tickled what may be a > hardware-level problem. >=20 >> But this is only one suite of testing. Scientific Linux is supposed to= >> give the best performance for scientifi purposes, i.e. for longhaul >> calculations, much numerical stuff. It outperforms in a typical server= >> application FreeBSd, were "FreeBSD shoulkd have the power to serve". >> >> Is the postgresql benchmark the only way to benchmark? >=20 > I sure hope not. But you know what's equally as interesting? This: >=20 > http://people.freebsd.org/~kris/scaling/ >=20 > Specifically circa 2008: >=20 > http://people.freebsd.org/~kris/scaling/4cpu-pgsql.png > http://people.freebsd.org/~kris/scaling/pgsql-16cpu-2.png > http://people.freebsd.org/~kris/scaling/pgsql-16cpu.png >=20 > Now, I don't know if what was used in those ("pgsql sysbench") was the > same thing as "pg_bench" in the DragonflyBSD tests, but if so, the > numbers are different to a point that is preposterous. >=20 > There's also this: >=20 > http://people.freebsd.org/~kris/scaling/pgsql-ncpu.png >=20 > Now, compare those numbers to the TPS numbers shown here: >=20 > http://dl.wolfpond.org/Pg-benchmarks.pdf >=20 > So um... yeah. Now, if someone here is going to say "well, what > was tested by Kris was FreeBSD 7.0, while what was tested by Francois > was FreeBSD 9.0, and there have been improvements", then I ask that > someone show me where the improvements are that would exhibit a 4-8x > performance increase in some cases. >=20 > This rambling of mine is the same rambling I posted earlier in this > thread. There needs to be a consistent, standardised way of testing > this stuff. Every system tested tuned the exact same way, software > configured the same way, absolutely no quirks applied, etc.. Otherwise= > we end up with "mixed results" as shown above. Didn't got M. Larabel at Phoronix this half the way, except the ZFS fault= ? >=20 > Much to the disapproval of others, the Phoronix test suite is supposed > to be that "standard". Meaning, it's a suite you're supposed to be abl= e > to install and thus ensures that, aside from compiler used and any > system tests, that the same code is being used regardless of what syste= m > and OS it's on. Have I ever used it? No. And it's important that I > admit that up front, because being honest is necessary. >=20 >> Well, this inspires me to gather together all the benchmarks someone >> could find. There were lots of compalins about FreeBSD's poor >> performance with BIND - once a domain of FreeBSD. Network performance >> seems also to be an issue if it comes to scalability. >> It would be nice to see what portion of the raw CPU/GPU power the OS >> (FreeBSD, Linux ...) delivers to scientific applications. >=20 > Kris Kenneway's "BIND benchmark" that was released a long time ago > touched base on this. Remember: these plots show nothing other than > number of queries per second correlated with number of DNS server > threads (since BIND does have a 1:1 thread-to-CPU creation ratio): >=20 > http://people.freebsd.org/~kris/scaling/bind-pt.png > http://people.freebsd.org/~kris/scaling/bind-pt-2.png > http://people.freebsd.org/~kris/scaling/bind-pt-gige.png >=20 >> I only know some kind of benchmarks, BYTE UNIX benchmark, LINPACK test= >> ... Does someone know a site to look for a couple of benchmarks to tes= t >> >> a) memory system >> b) scalability (apart from pgbench) >> c) network performance/throughput/network scalability >> d) portion of CPU performance the system delivers for numerical >> applications to the user apart from the system's own consumption >> e) disk I/O performance and scalability >> >> it would also be nice to discuss some nice settings and performance >> tunings for FreeBSD for several scenarios. I guess, starting developin= g >> benchmarking test scenarios for several purposes would lead faster to >> real numbers and non polemic than weird discussions ... >=20 > All I wish is that we had some kind of "test suite" of our own, maybe a= s > a port, maybe in the base system, which could really help with all of > this. Something consistent. Why not supporting those guys at Phoronix? If we start with "our own", then we end up as you described above - not comparable, different numbers on different platforms, no normalization possible. >=20 > Now I'm switching back to discussing interactivity/responsiveness tests= : >=20 > Attilio Rao did comment in this thread to me, giving me some test > methodologies for testing interactivity during two types of simultaneou= s > loads -- but one involves dnetc, which I imagine means I'd need to get > familiar with that whole thing. >=20 > http://lists.freebsd.org/pipermail/freebsd-stable/2011-December/064936.= html >=20 > I haven't responded to his post yet (this thread is so long and tedious= > that I'm having serious problems following it + remembering all the > details -- am I the only one who feels daunted by this? God I hope > not), but his insights are, as always, beneficial, but also > overwhelming. Furthermore, I do not have 16-core or 24-core systems > to test on -- I have single-CPU, quad-core and dual-core systems to tes= t > on. I am a firm believer these are going to make up the majority of th= e > FreeBSD userbase (desktop and server environments). Extreme hardware (= e.g. > quad CPU with 12 cores per CPU) can be tested too, but let's at least > pick a demographic to start with. >=20 > Again: the FreeBSD users and administrative community want to help. Al= l > of us do. We just need to know exactly what we should be doing to test= , > and what exactly we're testing for. I'll be blunt while choosing to > play the Idiot Admin for a moment: I'd be much happier if someone had a= > tarball of shell scripts and things which could be used to test these > things. Lots of things need to be kept in mind, such as if someone is > running the "client" test on the same box as the "server" test, and > things like "the test data is written to a local filesystem, with > echo/printf statements constantly flushed" (great, now we're causing I/= O > load on top of our tests!), which to me means we should probably be > using something like mdconfig(8) to create a temporary filesystem to > store logs/data results. >=20 > The KTR stuff Atillio and many others have requested, I think, will be > the most beneficial way to get the developers the data they need. I ha= d > no idea about it until I found out that KTR was something completely > different than ktrace. >=20 > I still haven't found the time to do all of this, BTW, and for that I > apologise. The reason has to do with time at work + personal desire to= > do it. When I get a daunting task, I tend to get... well, not > depressed, but "scared" of the massive undertaking since it involves > lots of recurring tests, reboots, etc. -- hours of work -- and if I get= > that wrong, it's wasted effort (thus wasted developer time). I want to= > get it right. :-) >=20 --------------enig3B0CE417BCECAA1895E10BDC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO8SgVAAoJEOgBcD7A/5N8hgIH/3OXj5P3KAZ7bAx0Xdcg93EP qU1qvXqmbf/H4QCYxWIEk7NG+TT5MoTIoRN9393F1n1+nkn8QRjU27NLqnPwFsbx cRk8VWQXtJ58DImkfHnAhmuScfScPrS5u5CDRs5LXS7cPT9r6NPZ6uyNr6qcEA7i Y5urmT8RLtPMZIcJRJx4i8BU0Wg314QxfH2AiOjiiS8vbIcXk3gYB+2C7VnPM2Le nvo2OYPW5T3t6KSwW/T2ikXSTNgKqy6YL9hX6Q/xZOvG/ZvXS/QkVNmnKuUgroqU A28ILznYmqnACfXrV4yzJAb04SrzxxCN8BgOwOs/zdzzzuQximfETIDNn44GYpY= =rq59 -----END PGP SIGNATURE----- --------------enig3B0CE417BCECAA1895E10BDC-- From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 01:18:14 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6F6B2106566B; Wed, 21 Dec 2011 01:18:14 +0000 (UTC) (envelope-from matthew@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 3263C8FC13; Wed, 21 Dec 2011 01:18:13 +0000 (UTC) Received: from palm-64-28-152-131.palm.com ([64.28.152.131] helo=LT740055CZ0L1.palm1.palmone.com) by phx1.phoronix.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1RdAot-0007Xv-N9; Tue, 20 Dec 2011 19:18:11 -0600 Message-ID: <4EF133D0.4050800@phoronix.com> Date: Tue, 20 Dec 2011 17:18:08 -0800 From: Matthew Tippett User-Agent: Mozilla/5.0 (X11; Linux i686; rv:9.0) Gecko/20111214 Thunderbird/9.0 MIME-Version: 1.0 To: "O. Hartmann" References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF10088.1010409@zedat.fu-berlin.de> In-Reply-To: <4EF10088.1010409@zedat.fu-berlin.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Cc: freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , Jeremy Chadwick , Igor Mozolevsky Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 01:18:14 -0000 For such a system, the greatest immediate value would be to attempt to reproduce the benchmarks in question. Install PTS from www.phoronix-test-suite.com or freshports.org. Run the benchmark against those used in the article phoronix-test-suite benchmark 1112113-AR-ORACLELIN37 You will be asked to push the comparison up to openbenchmarking at the end. Matthew On 12/20/2011 01:39 PM, O. Hartmann wrote: > On 12/20/11 21:20, Igor Mozolevsky wrote: >> Interestingly, while people seem to be (arguably rightly) focused on >> criticising Phoronix's benchmarking, nobody has offered an alternative >> benchmark; and while (again, arguably rightly) it is important to >> benchmark real world performance, equally, nobody has offered any >> numbers in relation to, for example, HTTP or SMTP, or any other "real >> world"-application torture tests done on the aforementioned two >> platforms... IMO, this just goes to show that "doing is hard" and >> "criticising is much easier" (yes, I am aware of the irony involved in >> making this statement, but someone has to!) >> >> >> Cheers, >> Igor M :-) > Unfortunately, M. Larabel is the only one who's performing benchmarks on > FreeBSD, comparing its performance to the Linux-opponents. Adn indeed, > there is a lot of criticism, but no alternative. > I said unfortunately - not offensive - since Larabel and Phoronix are > sadly the only ones who do actually such bechmarking. > > It would be much more nicer and kind to support those people. > > Well, in January/February we get new hardware. One box is supposed to do > number crunching via 12 cores and a TESLA GPU. My colleague is > developing a high parallelized peice of software for satellite data > transformation. The software package is CPU bound, partially GPU, but > massively memory hungry (96 to 128 GB RAM is needed). > What I can offer is, since I will also work on that machine and I've > free hand to administer, in the spare time of doing my PhD, installing > FreeBSD 9.0/10.0 besides SuSe Linux and looking forward having one ZFS > data storage drive for homes, so both systems can perform on a most > recent ZFS. I'm new to Linux, not a BSD guru, nor I'm a professional > programmer/developer. My skills are sufficient for the daily scientific > work. So, without pressure, I'm willing to perform some HPC benchmarks > under advice if the day comes and those interested in bare numbers of > FreeBSD vs. Linux performance with a real-world-scientific application. > > I would appreciate to see some of the developers and/or FreeBSD hackers > to help Phoronix setting up a proper testenvironment instead of bashing > M. Larabel and his fellows. > > Regards, > Oliver > From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 01:29:31 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29EA01065675; Wed, 21 Dec 2011 01:29:31 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 992F88FC13; Wed, 21 Dec 2011 01:29:30 +0000 (UTC) Received: by vcbfk1 with SMTP id fk1so9273525vcb.13 for ; Tue, 20 Dec 2011 17:29:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=uiHoaCecTy8i62ljEyDn8TNea/c6xahUxa/A1fPBeb8=; b=Pzqnx0y4tN2mVFfGo8rcVLAmixoHR43lvNtAchgG9UNe85vmr3QyydHPk94wcKAioF 0jQgWZ7uYvYfOk3KxQ6DzFXzKcAC6VHaL1F4RX94LCRuNSvmQ2VySZRbDGvqAVwuLEph QJ3m2D6h7ZlDla07+qPflASsqkV+8ZJMLdHE4= MIME-Version: 1.0 Received: by 10.220.232.10 with SMTP id js10mr3491829vcb.2.1324430969838; Tue, 20 Dec 2011 17:29:29 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.158.104 with HTTP; Tue, 20 Dec 2011 17:29:29 -0800 (PST) In-Reply-To: <4EF133D0.4050800@phoronix.com> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF10088.1010409@zedat.fu-berlin.de> <4EF133D0.4050800@phoronix.com> Date: Tue, 20 Dec 2011 17:29:29 -0800 X-Google-Sender-Auth: 62l0R5YMedc4zy-sUOAXdflMBKE Message-ID: From: Adrian Chadd To: Matthew Tippett Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Stable Mailing List , Current FreeBSD , Igor Mozolevsky , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 01:29:31 -0000 Is there a specific version of the test suite that should be used, to compare against the published results? Adrian On 20 December 2011 17:18, Matthew Tippett wrote: > For such a system, the greatest immediate value would be to attempt to > reproduce the benchmarks in question. > > Install PTS from www.phoronix-test-suite.com or freshports.org. > > Run the benchmark against those used in the article > > =A0 =A0phoronix-test-suite benchmark 1112113-AR-ORACLELIN37 > > You will be asked to push the comparison up to openbenchmarking at the en= d. > > Matthew > > > On 12/20/2011 01:39 PM, O. Hartmann wrote: >> >> On 12/20/11 21:20, Igor Mozolevsky wrote: >>> >>> Interestingly, while people seem to be (arguably rightly) focused on >>> criticising Phoronix's benchmarking, nobody has offered an alternative >>> benchmark; and while (again, arguably rightly) it is important to >>> benchmark real world performance, equally, nobody has offered any >>> numbers in relation to, for example, HTTP or SMTP, or any other "real >>> world"-application torture tests done on the aforementioned two >>> platforms... IMO, this just goes to show that "doing is hard" and >>> "criticising is much easier" (yes, I am aware of the irony involved in >>> making this statement, but someone has to!) >>> >>> >>> Cheers, >>> Igor M :-) >> >> Unfortunately, M. Larabel is the only one who's performing benchmarks on >> FreeBSD, comparing its performance to the Linux-opponents. Adn indeed, >> there is a lot of criticism, but no alternative. >> I said unfortunately - not offensive - since Larabel and Phoronix are >> sadly the only ones who do actually such bechmarking. >> >> It would be much more nicer and kind to support those people. >> >> Well, in January/February we get new hardware. One box is supposed to do >> number crunching via 12 cores and a TESLA GPU. My colleague is >> developing a high parallelized peice of software for satellite data >> transformation. The software package is CPU bound, partially GPU, but >> massively memory hungry (96 to 128 GB RAM is needed). >> What I can offer is, since I will also work on that machine and I've >> free hand to administer, in the spare time of doing my PhD, installing >> FreeBSD 9.0/10.0 besides SuSe Linux and looking forward having one ZFS >> data storage drive for homes, so both systems can perform on a most >> recent ZFS. I'm new to Linux, not a BSD guru, nor I'm a professional >> programmer/developer. My skills are sufficient for the daily scientific >> work. So, without pressure, I'm willing to perform some HPC benchmarks >> under advice if the day comes and those interested in bare numbers of >> FreeBSD vs. Linux performance with a real-world-scientific application. >> >> I would appreciate to see some of the developers and/or FreeBSD hackers >> to help Phoronix setting up a proper testenvironment instead of bashing >> M. Larabel and his fellows. >> >> Regards, >> Oliver >> > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 01:37:33 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDE8E106566B; Wed, 21 Dec 2011 01:37:33 +0000 (UTC) (envelope-from matthew@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 888C58FC14; Wed, 21 Dec 2011 01:37:33 +0000 (UTC) Received: from mobile-166-205-136-198.mycingular.net ([166.205.136.198] helo=www.palm.com) by phx1.phoronix.com with esmtpa (Exim 4.69) (envelope-from ) id 1RdB7b-0007Hu-W1; Tue, 20 Dec 2011 19:37:32 -0600 Date: Tue, 20 Dec 2011 17:37:29 -0800 From: To: "Adrian Chadd" In-Reply-To: X-Mailer: Palm webOS X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Message-Id: <20111221013733.BDE8E106566B@hub.freebsd.org> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: FreeBSD Stable Mailing List , Current FreeBSD , Igor Mozolevsky , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 01:37:33 -0000 The benchmarks themselves are versioned. So in general most of the av= ailable versions of PTS itself should be fine. PTS can be considered = an execution shell that doesn't affect the benchmark itself. Note th= at you'll download a pile of the benchmarks, build and install them. = Then you run about 49 individual steps. Matthew -- Sent from my HP Pre3 _________________________________________________________________ On Dec 20, 2011 5:30 PM, Adrian Chadd = ; wrote: Is there a specific version of the test suite that = should be used, to=0D compare against the published results?=0D =0D=0D Adrian=0D =0D On 20 December 2011 17:18, Matthew Tippett <= ;matthew@phoronix.com> wrote:=0D > For such a system, the greatest= immediate value would be to attempt to=0D > reproduce the benchmarks= in question.=0D >=0D > Install PTS from www.phoronix-test-suit= e.com or freshports.org.=0D >=0D > Run the benchmark against th= ose used in the article=0D >=0D > =C2=A0 =C2=A0phoronix-test-su= ite benchmark 1112113-AR-ORACLELIN37=0D >=0D > You will be aske= d to push the comparison up to openbenchmarking at the end.=0D >=0D> Matthew=0D >=0D >=0D > On 12/20/2011 01:39 PM, O. = Hartmann wrote:=0D >>=0D >> On 12/20/11 21:20, Igor Mozol= evsky wrote:=0D >>>=0D >>> Interestingly, while peo= ple seem to be (arguably rightly) focused on=0D >>> criticising= Phoronix's benchmarking, nobody has offered an alternative=0D >>&= gt; benchmark; and while (again, arguably rightly) it is important to=0D >>> benchmark real world performance, equally, nobody has offered= any=0D >>> numbers in relation to, for example, HTTP or SMTP, = or any other "real=0D >>> world"-application torture tests done= on the aforementioned two=0D >>> platforms... IMO, this just g= oes to show that "doing is hard" and=0D >>> "criticising is muc= h easier" (yes, I am aware of the irony involved in=0D >>> maki= ng this statement, but someone has to!)=0D >>>=0D >>&g= t;=0D >>> Cheers,=0D >>> Igor M :-)=0D >>= =0D >> Unfortunately, M. Larabel is the only one who's performing = benchmarks on=0D >> FreeBSD, comparing its performance to the Linu= x-opponents. Adn indeed,=0D >> there is a lot of criticism, but no= alternative.=0D >> I said unfortunately - not offensive - since L= arabel and Phoronix are=0D >> sadly the only ones who do actually = such bechmarking.=0D >>=0D >> It would be much more nicer= and kind to support those people.=0D >>=0D >> Well, in J= anuary/February we get new hardware. One box is supposed to do=0D >&g= t; number crunching via 12 cores and a TESLA GPU. My colleague is=0D >= ;> developing a high parallelized peice of software for satellite data= =0D >> transformation. The software package is CPU bound, partiall= y GPU, but=0D >> massively memory hungry (96 to 128 GB RAM is need= ed).=0D >> What I can offer is, since I will also work on that mac= hine and I've=0D >> free hand to administer, in the spare time of = doing my PhD, installing=0D >> FreeBSD 9.0/10.0 besides SuSe Linux= and looking forward having one ZFS=0D >> data storage drive for h= omes, so both systems can perform on a most=0D >> recent ZFS. I'm = new to Linux, not a BSD guru, nor I'm a professional=0D >> program= mer/developer. My skills are sufficient for the daily scientific=0D >= > work. So, without pressure, I'm willing to perform some HPC benchmarks= =0D >> under advice if the day comes and those interested in bare = numbers of=0D >> FreeBSD vs. Linux performance with a real-world-s= cientific application.=0D >>=0D >> I would appreciate to = see some of the developers and/or FreeBSD hackers=0D >> to help Ph= oronix setting up a proper testenvironment instead of bashing=0D >>= ; M. Larabel and his fellows.=0D >>=0D >> Regards,=0D = >> Oliver=0D >>=0D >=0D > ______________________= _________________________=0D > freebsd-stable@freebsd.org mailing lis= t=0D > http://lists.freebsd.org/mailman/listinfo/freebsd-stable=0D > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.= org"=0D _______________________________________________=0D freebsd-pe= rformance@freebsd.org mailing list=0D http://lists.freebsd.org/mailman/l= istinfo/freebsd-performance=0D To unsubscribe, send any mail to "freebsd= -performance-unsubscribe@freebsd.org"=0D From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 01:38:33 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 45152106564A; Wed, 21 Dec 2011 01:38:33 +0000 (UTC) (envelope-from michael.larabel@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 0EC348FC2A; Wed, 21 Dec 2011 01:38:32 +0000 (UTC) Received: from c-98-193-96-120.hsd1.il.comcast.net ([98.193.96.120] helo=[172.16.93.133]) by phx1.phoronix.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1RdB8a-0007JA-Gg; Tue, 20 Dec 2011 19:38:32 -0600 Message-ID: <4EF13895.9060307@phoronix.com> Date: Tue, 20 Dec 2011 19:38:29 -0600 From: Michael Larabel User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:8.0) Gecko/20111110 Thunderbird/8.0 MIME-Version: 1.0 To: Adrian Chadd References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF10088.1010409@zedat.fu-berlin.de> <4EF133D0.4050800@phoronix.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Cc: FreeBSD Stable Mailing List , Matthew Tippett , Current FreeBSD , Igor Mozolevsky , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 01:38:33 -0000 Any version is fine that's PTS 3.0 or newer in terms of being compatible, since the test profiles are versioned separately and automatically fetched to match the result file. However, I'd recommended the newest (PTS 3.6) as it contains the best FreeBSD support at present in terms of hardware/software information parsing (for the automated table), etc. Michael On 12/20/2011 07:29 PM, Adrian Chadd wrote: > Is there a specific version of the test suite that should be used, to > compare against the published results? > > > Adrian > > On 20 December 2011 17:18, Matthew Tippett wrote: >> For such a system, the greatest immediate value would be to attempt to >> reproduce the benchmarks in question. >> >> Install PTS from www.phoronix-test-suite.com or freshports.org. >> >> Run the benchmark against those used in the article >> >> phoronix-test-suite benchmark 1112113-AR-ORACLELIN37 >> >> You will be asked to push the comparison up to openbenchmarking at the end. >> >> Matthew >> >> >> On 12/20/2011 01:39 PM, O. Hartmann wrote: >>> On 12/20/11 21:20, Igor Mozolevsky wrote: >>>> Interestingly, while people seem to be (arguably rightly) focused on >>>> criticising Phoronix's benchmarking, nobody has offered an alternative >>>> benchmark; and while (again, arguably rightly) it is important to >>>> benchmark real world performance, equally, nobody has offered any >>>> numbers in relation to, for example, HTTP or SMTP, or any other "real >>>> world"-application torture tests done on the aforementioned two >>>> platforms... IMO, this just goes to show that "doing is hard" and >>>> "criticising is much easier" (yes, I am aware of the irony involved in >>>> making this statement, but someone has to!) >>>> >>>> >>>> Cheers, >>>> Igor M :-) >>> Unfortunately, M. Larabel is the only one who's performing benchmarks on >>> FreeBSD, comparing its performance to the Linux-opponents. Adn indeed, >>> there is a lot of criticism, but no alternative. >>> I said unfortunately - not offensive - since Larabel and Phoronix are >>> sadly the only ones who do actually such bechmarking. >>> >>> It would be much more nicer and kind to support those people. >>> >>> Well, in January/February we get new hardware. One box is supposed to do >>> number crunching via 12 cores and a TESLA GPU. My colleague is >>> developing a high parallelized peice of software for satellite data >>> transformation. The software package is CPU bound, partially GPU, but >>> massively memory hungry (96 to 128 GB RAM is needed). >>> What I can offer is, since I will also work on that machine and I've >>> free hand to administer, in the spare time of doing my PhD, installing >>> FreeBSD 9.0/10.0 besides SuSe Linux and looking forward having one ZFS >>> data storage drive for homes, so both systems can perform on a most >>> recent ZFS. I'm new to Linux, not a BSD guru, nor I'm a professional >>> programmer/developer. My skills are sufficient for the daily scientific >>> work. So, without pressure, I'm willing to perform some HPC benchmarks >>> under advice if the day comes and those interested in bare numbers of >>> FreeBSD vs. Linux performance with a real-world-scientific application. >>> >>> I would appreciate to see some of the developers and/or FreeBSD hackers >>> to help Phoronix setting up a proper testenvironment instead of bashing >>> M. Larabel and his fellows. >>> >>> Regards, >>> Oliver >>> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 02:23:24 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id 6C165106566B; Wed, 21 Dec 2011 02:23:24 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: from 172-17-198-245.globalsuite.net (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id F157914E2B1; Wed, 21 Dec 2011 02:23:23 +0000 (UTC) Message-ID: <4EF1431B.8060909@FreeBSD.org> Date: Tue, 20 Dec 2011 18:23:23 -0800 From: Doug Barton Organization: http://SupersetSolutions.com/ User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111110 Thunderbird/8.0 MIME-Version: 1.0 To: Claude Buisson References: <4EF05CEC.6080603@orange.fr> In-Reply-To: <4EF05CEC.6080603@orange.fr> X-Enigmail-Version: undefined OpenPGP: id=1A1ABC84 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, FreeBSD Current Subject: Re: Is the svn2cvs gateway down ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 02:23:24 -0000 On 12/20/2011 02:01, Claude Buisson wrote: > Hi, > > It seems (from my own csup's and cvswe.cgi) that the src commits are lost, > starting with r228697 Sun Dec 18 22:04:55 2011) Yeah, my warning 2 days ago that this was going to happen seems to have gone un-heeded. :) I'm sure you can take bz' word that it's being looked at now though. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 05:22:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9E6C8106566B for ; Wed, 21 Dec 2011 05:22:50 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) by mx1.freebsd.org (Postfix) with ESMTP id B7ECD8FC08 for ; Wed, 21 Dec 2011 05:22:49 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id pBL5Mfdd043778; Wed, 21 Dec 2011 16:22:41 +1100 (EST) (envelope-from smithi@nimnet.asn.au) Date: Wed, 21 Dec 2011 16:22:41 +1100 (EST) From: Ian Smith To: "Samuel J. Greear" In-Reply-To: Message-ID: <20111220033328.I64681@sola.nimnet.asn.au> References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-2065991131-1324317421=:64681" Content-ID: <20111221152941.J64681@sola.nimnet.asn.au> Cc: "O. Hartmann" , Adrian Chadd , lev@freebsd.org, FreeBSD Stable Mailing List , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 05:22:50 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-2065991131-1324317421=:64681 Content-Type: TEXT/PLAIN; CHARSET=ISO-8859-1 Content-Transfer-Encoding: 8BIT Content-ID: <20111221152941.C64681@sola.nimnet.asn.au> [performance@ & current@ ccs trimmed, I'm not subscribed. Feel free ..] On Mon, 19 Dec 2011, Samuel J. Greear wrote: > 2011/12/19 Lev Serebryakov : > > Hello, Samuel. > > You wrote 15 ÿÿÿÿÿÿÿÿÿÿÿÿÿÿ 2011 ÿÿ., 16:32:47: > > > >> Other benchmarks in the Phoronix suite and their representations are > >> similarly flawed, _ALL_ of these results should be ignored and no time > >> should be wasted by any FreeBSD committer further evaluating this > >> garbage. (Yes, I have been down this rabbit hole). I downloaded the sources the other night, poked around a bit trying to suss out the test environment and FreeBSD dependencies. Gobs of PHP and shell scripts for those with time on their hands, but I concentrated on *BSD installation and such for a couple of hours. Observations below. > >  Here is one problem: we have choice from three items: > > > > (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD Or use benchmarks and kernel tuning to suit, where FreeBSD can shine :) > > (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix > > (communication with them, convincing, that they benchamrks are unfare > > / meaningless, ets) I've no idea whether GPLv3 really allows us to fix it ourselves, but the general orientation is entirely Linux, with {free,net}bsd as 'distros', so to speak. No blame there, just so long as that emphasis is clear. > > (3) Lose [potential] userbase. > > > >  You know, that these benchmarks are bad. I know. But potential (and > >  even some current!) user doesn't. And it seems, that these benchmarks > >  become popular over Internet. > > > > -- > > // Black Lion AKA Lev Serebryakov Self-selected, like a 'Standard & Poors' of the OS 'market'? :) People who choose OS by fan base have already made their choice, and were never 'ours' to lose. Recall the Benchmark Battles between Windows and Linux? > Here is where you completely derail the train, let me paste again what > I said before. > > ... > Take the first test as an example, Blogbench read. This doesn't raise > any red flags, right? At least not until you realize that Blogbench > isn't a read test, it's a read/write test. So what they have done here > is run a read/write test and then thrown away the write results for > both platforms and reported only the read results. If you dig down > into the actual results, > http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will > see two Blogbench numbers, one for read and another for write. These > were both taken from the same Blogbench run, so FreeBSD optimizes > writes over reads, that's probably a good thing for your data but a > bad thing when someone totally misrepresents benchmark results. > ... > > FreeBSD actually does _BETTER_ (subjectively) in this test than the > Linux system when you look at what is really going on. FreeBSD is > favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, > the benchmarks need to be fixed to represent reality rather than > throwing half of the results in the trash. To be quite frank, "fixing" > FreeBSD to look good on this benchmark will make it a worse real-world > OS. But you guys go ahead and foot-shoot over these ridiculous > benchmarks all you want. > > Sam I think the notion that installing FreeBSD with no tuning at all for particular types of work can give comparable results is flawed, when optimising for widely varying types of workload is normally expected. Noone expects a database, file or web server, probably headless, to be configured anything like the same as, say, a scientific workstation or a multimedia box or a high-performance router or .. I've only installed Linux twice, Debian Etch and Lenny. I soon gave up trying to install Lenny sans X and Gnome. I'm sure it can be done, by fighting the line of least resistance. My point is that out of the box, basic configuration and (I suspect) tuning of FreeBSD and Linux systems has quite a different emphasis, and likely expected workload/s. One thing I'd like to see is even 'ps -auxww' listings of these setups while actually running these tests. Not only PHP and X but all sorts of stuff gets installed and some are presumed to be running on top of the benchmarks per se, NetBSD even having a jdk dependency; I was a little unnerved to see the substantial list of packages to install seen in: ./pts-core/external-test-dependencies/xml/freebsd-packages.xml presumably, where the listed executables are not found, installed by: ./pts-core/external-test-dependencies/scripts/install-freebsd-packages.sh: #!/bin/sh # FreeBSD package installation echo "Please enter your root password below:" 1>&2 su root -c "PACKAGESITE=\"ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7-stable/Latest/\" pkg_add -r $*" exit Hmm. Would the 'ordinary user' of this software be expected to notice and adjust PACKAGESITE for later versions? I admit to not having read the substantial docs - it's an admirably large body of work, no mistake - but I've spent too long 'down this rabbit hole' already. I find the results on this page very strange, but perhaps indicative: http://www.phoronix.com/scan.php?page=article&item=debian_kfreebsd_h210&num=1 Here we see scant difference in results between Debian running FreeBSD 7.3 or 8.0 or Linux 2.6.32 kernels, yet native FreeBSD 7.3 and 8.0 installations apparently run far slower, especially on the gzip test! Does this imply that given the similar kernel speed, Debian GNU userland performs so dramatically better than FreeBSD userland? Or does it perhaps point to the default tuning of the FreeBSD systems compared to (here) Debian, for these particular tests? Indeed, `which gzip`? And yes, FreeBSD could sure use some sort of tuning 'profiles' mechanism to be able to preconfigure systems for at least several vastly different types of workload. Nate Lawson used to talk about this, then in respect to simple 'laptop vs desktop' scenarios, but we've since seen volumes written, mostly in lists but some wikis, parts of the Handbook, guides for performance tuning etc, scarcely accessible to J. Random Installer. A set of tunings for these Phoronix benchmarks might be a good start? cheers, Ian --0-2065991131-1324317421=:64681-- From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 07:09:04 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C36FE106566C; Wed, 21 Dec 2011 07:09:04 +0000 (UTC) (envelope-from michael.larabel@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 873D38FC0C; Wed, 21 Dec 2011 07:09:04 +0000 (UTC) Received: from c-98-193-96-120.hsd1.il.comcast.net ([98.193.96.120] helo=[172.16.93.133]) by phx1.phoronix.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69) (envelope-from ) id 1RdGIN-0005ce-PI; Wed, 21 Dec 2011 01:08:59 -0600 Message-ID: <4EF18608.30404@phoronix.com> Date: Wed, 21 Dec 2011 01:08:56 -0600 From: Michael Larabel User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:8.0) Gecko/20111110 Thunderbird/8.0 To: Ian Smith References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> <20111220033328.I64681@sola.nimnet.asn.au> In-Reply-To: <20111220033328.I64681@sola.nimnet.asn.au> Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com MIME-Version: 1.0 Content-Type: text/plain; charset="ISO-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Adrian Chadd , lev@freebsd.org, "Samuel J. Greear" , FreeBSD Stable Mailing List , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 07:09:04 -0000 On 12/20/2011 11:22 PM, Ian Smith wrote: [performance@ & current@ ccs trimmed, I'm not subscribed. Feel free ..] On Mon, 19 Dec 2011, Samuel J. Greear wrote: > 2011/12/19 Lev Serebryakov [1]: > > Hello, Samuel. > > You wrote 15 ÿÿÿÿÿÿÿÿÿÿÿÿÿÿ 2011 ÿÿ., 16:32:47: > > > >> Other benchmarks in the Phoronix suite and their representations are > >> similarly flawed, _ALL_ of these results should be ignored and no time > >> should be wasted by any FreeBSD committer further evaluating this > >> garbage. (Yes, I have been down this rabbit hole). I downloaded the sources the other night, poked around a bit trying to suss out the test environment and FreeBSD dependencies. Gobs of PHP and shell scripts for those with time on their hands, but I concentrated on *BSD installation and such for a couple of hours. Observations below. > > Here is one problem: we have choice from three items: > > > > (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD Or use benchmarks and kernel tuning to suit, where FreeBSD can shine :) > > (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix > > (communication with them, convincing, that they benchamrks are unfare > > / meaningless, ets) I've no idea whether GPLv3 really allows us to fix it ourselves, but the general orientation is entirely Linux, with {free,net}bsd as 'distros', so to speak. No blame there, just so long as that emphasis is clear. > > (3) Lose [potential] userbase. > > > > You know, that these benchmarks are bad. I know. But potential (and > > even some current!) user doesn't. And it seems, that these benchmarks > > become popular over Internet. > > > > -- > > // Black Lion AKA Lev Serebryakov [2] Self-selected, like a 'Standard & Poors' of the OS 'market'? :) People who choose OS by fan base have already made their choice, and were never 'ours' to lose. Recall the Benchmark Battles between Windows and Linux? > Here is where you completely derail the train, let me paste again what > I said before. > > ... > Take the first test as an example, Blogbench read. This doesn't raise > any red flags, right? At least not until you realize that Blogbench > isn't a read test, it's a read/write test. So what they have done here > is run a read/write test and then thrown away the write results for > both platforms and reported only the read results. If you dig down > into the actual results, > [3]http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will > see two Blogbench numbers, one for read and another for write. These > were both taken from the same Blogbench run, so FreeBSD optimizes > writes over reads, that's probably a good thing for your data but a > bad thing when someone totally misrepresents benchmark results. > ... > > FreeBSD actually does _BETTER_ (subjectively) in this test than the > Linux system when you look at what is really going on. FreeBSD is > favoring writes, which is _GOOD_. FreeBSD does not need to be fixed, > the benchmarks need to be fixed to represent reality rather than > throwing half of the results in the trash. To be quite frank, "fixing" > FreeBSD to look good on this benchmark will make it a worse real-world > OS. But you guys go ahead and foot-shoot over these ridiculous > benchmarks all you want. > > Sam I think the notion that installing FreeBSD with no tuning at all for particular types of work can give comparable results is flawed, when optimising for widely varying types of workload is normally expected. Noone expects a database, file or web server, probably headless, to be configured anything like the same as, say, a scientific workstation or a multimedia box or a high-performance router or .. I've only installed Linux twice, Debian Etch and Lenny. I soon gave up trying to install Lenny sans X and Gnome. I'm sure it can be done, by fighting the line of least resistance. My point is that out of the box, basic configuration and (I suspect) tuning of FreeBSD and Linux systems has quite a different emphasis, and likely expected workload/s. One thing I'd like to see is even 'ps -auxww' listings of these setups while actually running these tests. Not only PHP and X but all sorts of stuff gets installed and some are presumed to be running on top of the benchmarks per se, NetBSD even having a jdk dependency; I was a little unnerved to see the substantial list of packages to install seen in: ./pts-core/external-test-dependencies/xml/freebsd-packages.xml presumably, where the listed executables are not found, installed by: ./pts-core/external-test-dependencies/scripts/install-freebsd-packages.sh: #!/bin/sh # FreeBSD package installation echo "Please enter your root password below:" 1>&2 su root -c "PACKAGESITE=\[4]"ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packa ges-7-stable/Latest/\" pkg_add -r $*" exit This file isn't even used at present in the Phoronix Test Suite but if there is a needed external dependency the user is prompted to install it, but besides I believe the only external dependency that 95% of the BSD-compatible tests are using is just a compiler stack. -- Michael Hmm. Would the 'ordinary user' of this software be expected to notice and adjust PACKAGESITE for later versions? I admit to not having read the substantial docs - it's an admirably large body of work, no mistake - but I've spent too long 'down this rabbit hole' already. I find the results on this page very strange, but perhaps indicative: [5]http://www.phoronix.com/scan.php?page=article&item=debian_kfreebsd_h210&num= 1 Here we see scant difference in results between Debian running FreeBSD 7.3 or 8.0 or Linux 2.6.32 kernels, yet native FreeBSD 7.3 and 8.0 installations apparently run far slower, especially on the gzip test! Does this imply that given the similar kernel speed, Debian GNU userland performs so dramatically better than FreeBSD userland? Or does it perhaps point to the default tuning of the FreeBSD systems compared to (here) Debian, for these particular tests? Indeed, `which gzip`? And yes, FreeBSD could sure use some sort of tuning 'profiles' mechanism to be able to preconfigure systems for at least several vastly different types of workload. Nate Lawson used to talk about this, then in respect to simple 'laptop vs desktop' scenarios, but we've since seen volumes written, mostly in lists but some wikis, parts of the Handbook, guides for performance tuning etc, scarcely accessible to J. Random Installer. A set of tunings for these Phoronix benchmarks might be a good start? cheers, Ian _______________________________________________ [6]freebsd-stable@freebsd.org mailing list [7]http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [8]"freebsd-stable-unsubscribe@freebsd.org" References 1. mailto:lev@freebsd.org 2. mailto:lev@FreeBSD.org 3. http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 4. ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7-stable/Latest/\ 5. http://www.phoronix.com/scan.php?page=article&item=debian_kfreebsd_h210&num=1 6. mailto:freebsd-stable@freebsd.org 7. http://lists.freebsd.org/mailman/listinfo/freebsd-stable 8. mailto:freebsd-stable-unsubscribe@freebsd.org From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 07:59:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EFEE21065672 for ; Wed, 21 Dec 2011 07:59:11 +0000 (UTC) (envelope-from se@freebsd.org) Received: from nm37-vm4.bullet.mail.ne1.yahoo.com (nm37-vm4.bullet.mail.ne1.yahoo.com [98.138.229.132]) by mx1.freebsd.org (Postfix) with SMTP id B03938FC12 for ; Wed, 21 Dec 2011 07:59:11 +0000 (UTC) Received: from [98.138.90.57] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 21 Dec 2011 07:46:13 -0000 Received: from [98.138.84.35] by tm10.bullet.mail.ne1.yahoo.com with NNFMP; 21 Dec 2011 07:46:13 -0000 Received: from [127.0.0.1] by smtp103.mail.ne1.yahoo.com with NNFMP; 21 Dec 2011 07:46:13 -0000 X-Yahoo-Newman-Id: 137557.69753.bm@smtp103.mail.ne1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: MDf8xAMVM1mfb2E27ymcozVpfFXWzTho_r1OWxttib0SFkX m4U8QbmANUpfvO03YVT3qL2JL7UzmBA1InIC91xVMpwabs_.VgAXxqtSygAU BrLM4HdaiRDhCb3F8p3cyuXe8axanaE7QZiQ3tkhM5.gH3.NCBCt_RKqzDzP JRqmWhYldJLT3B4p5avvRlQo8fzB0mN4VecGYkUtot797lzuU6E3k2N98lMF GJq5meqJu2qdHEGjKqQusmsw71OoJ6dssJpad2BxrVQXFnoS3IuQfNwKi6b6 hNwJfV3VnxAkToAjJr6Fqi2Oub2ctcJb09atv3xdxz29Xny9cjvNPiw35L_G _3AJ0ReoTDuNfCA1LpEqCjbr_p29P4_cjqOENHPFW5WIqLBlRnstEpysRXwZ BNZjanDa2fBiWoD2pfo6gvoEyzxC2Xe0tbWTTWy9x4M.u.Av8XDvJDwGcjgO E.VOXeRGPAQBxq0MMlBSv0z6JjCCxz8zxudQHv2BzlPYYJmlHVfvO8DiVzBy NdvCpgitemKba.nT9ARy8Ll_BaH0_ X-Yahoo-SMTP: iDf2N9.swBDAhYEh7VHfpgq0lnq. Received: from [192.168.119.20] (se@81.173.148.77 with plain) by smtp103.mail.ne1.yahoo.com with SMTP; 20 Dec 2011 23:46:12 -0800 PST Message-ID: <4EF18EBC.9050103@freebsd.org> Date: Wed, 21 Dec 2011 08:46:04 +0100 From: Stefan Esser User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Ian Smith References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <6140271.20111219122721@serebryakov.spb.ru> <20111220033328.I64681@sola.nimnet.asn.au> In-Reply-To: <20111220033328.I64681@sola.nimnet.asn.au> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Adrian Chadd , lev@freebsd.org, "Samuel J. Greear" , FreeBSD Stable Mailing List , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 07:59:12 -0000 Am 21.12.2011 06:22, schrieb Ian Smith: > I find the results on this page very strange, but perhaps indicative: > > http://www.phoronix.com/scan.php?page=article&item=debian_kfreebsd_h210&num=1 > > Here we see scant difference in results between Debian running FreeBSD > 7.3 or 8.0 or Linux 2.6.32 kernels, yet native FreeBSD 7.3 and 8.0 > installations apparently run far slower, especially on the gzip test! You did not expect this, since all user space programs were compiled from identical sources, as were FreeBSD and kFreeBSD (probably with minimal deviations in kFreeBSD, which should not affect the results)? > Does this imply that given the similar kernel speed, Debian GNU userland > performs so dramatically better than FreeBSD userland? Or does it > perhaps point to the default tuning of the FreeBSD systems compared to > (here) Debian, for these particular tests? Indeed, `which gzip`? Well, the answer is quite simple: Just run the Linux binaries on FreeBSD or kFreeBSD (those compiled for testing Linux performance) and I'm convinced that you'll find that performance significantly improves. You did notice, that the 7-zip and gzip binaries were built with gcc-4.4.4 for Linux and with gcc-4.2.1 for FreeBSD? And another point: The relative advantage between FreeBSD and Linux is different on R52 and T61. Might it be the case that gcc-4.4.4 has better knowledge of the newer CPU in the latter (T61, Core 2 Duo) and optimizes for it, not for the CPU in the R52 (Pentium-M) anymore? And apparently 7-zip results are less affected by the compiler version than the gzip results. This also hints at the compiler as the reason for the better kFreeBSD and Linux results. (7-zip seems to be less dependent on the better optimization of the newer gcc, or it does not take as much advantage from it.) Funny is the finding, that gzip is measured slower on FreeBSD 7.3 than 8.0 on the Pentium-M, while it is faster on 7.3 on the Core 2 Duo. That does not match my expectations at all ... There are no technical reasons, that FreeBSD does not come with a newer GCC, as probably all in this list know. But OTOH, the newer GCC versions can easily be installed from a port or package, and thus it would not have been impossible to compare native binaries compiled with the same compiler version for all test cases. > And yes, FreeBSD could sure use some sort of tuning 'profiles' mechanism > to be able to preconfigure systems for at least several vastly different > types of workload. Nate Lawson used to talk about this, then in respect > to simple 'laptop vs desktop' scenarios, but we've since seen volumes > written, mostly in lists but some wikis, parts of the Handbook, guides > for performance tuning etc, scarcely accessible to J. Random Installer. > A set of tunings for these Phoronix benchmarks might be a good start? I doubt that tuning is responsible, because kFreeBSD performed better (with the test programs compiled with gcc-4.4.4). The benchmark measured just that, the better optimization of the newer gcc version. Install the port (perhaps an even later gcc version, gcc-4.5 is said to generate even better code than gcc-4.4) and make it the default compiler for ports, if you want to take advantage of the more advanced compiler. The FreeBSD ports system makes that very easy. BTW: Why don't we build binary packages with a later version of gcc than what is in the system. This should not cause any GPLv3 violation, and we could have the userland built with the compiler giving best performance ... Regards, Stefan From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 09:04:06 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 53724106564A for ; Wed, 21 Dec 2011 09:04:06 +0000 (UTC) (envelope-from ftigeot@wolfpond.org) Received: from sabik.zefyris.com (sabik.zefyris.com [IPv6:2001:7a8:bd07:2::254]) by mx1.freebsd.org (Postfix) with ESMTP id AE1238FC18 for ; Wed, 21 Dec 2011 09:04:05 +0000 (UTC) Received: from sekishi.zefyris.com (sekishi.zefyris.com [IPv6:2001:7a8:bd07:2:219:d1ff:fe81:e03]) by sabik.zefyris.com (8.14.5/8.14.5) with ESMTP id pBL93wmI022217; Wed, 21 Dec 2011 10:03:58 +0100 (CET) Date: Wed, 21 Dec 2011 10:03:57 +0100 From: Francois Tigeot To: Jeremy Chadwick Message-ID: <20111221090357.GA982@sekishi.zefyris.com> References: <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <4EF1121F.9010209@zedat.fu-berlin.de> <20111220232925.GA55953@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111220232925.GA55953@icarus.home.lan> User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (sabik.zefyris.com [IPv6:2001:7a8:bd07:2::254]); Wed, 21 Dec 2011 10:03:59 +0100 (CET) Cc: "Samuel J. Greear" , freebsd-performance@freebsd.org, Current FreeBSD , FreeBSD Stable Mailing List , kernel@crater.dragonflybsd.org Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 09:04:06 -0000 On Tue, Dec 20, 2011 at 03:29:25PM -0800, Jeremy Chadwick wrote: > > This also interested me: > > * Linux system crashed > http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00008.html > > * OpenIndiana system crashed same way as Linux system > http://leaf.dragonflybsd.org/mailarchive/kernel/2011-11/msg00017.html > > I cannot help but wonder if the Linux and OpenIndiana installations were > more stressful on the hardware -- getting more out of the system, maybe > resulting in increased power/load, which in turn resulted in the systems > locking up (shoddy PSU, unstable mainboard, MCH problems, etc.). > > My point is that Francois states these things in such a way to imply > that "DragonflyBSD was more stable", Same thing can be said for FreeBSD, only Linux and OpenIndiana crashed reliably if I remember correctly. > when in fact I happen to wonder the > opposite point -- that is to say, Linux and OpenIndiana were trying to > use the hardware more-so than DragonflyBSD, thus tickled what may be a > hardware-level problem. I actually ran the benchmarks on two different machines with the same hardware -- brand new Supermicro boxes with ECC memory and no cut corners. Since then, I've found I could stop the Linux crashes by disabling some options in the BIOS setup: - advanced ACPI settings (don't remember exactly which ones) - and a new WHEA one. WHEA means Windows Hardware Error Architecture. For all I know, it may have been the only culprit but I didn't have time to verify if the machines also ran fine with only this option disabled. -- Francois Tigeot From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 10:41:32 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D634B106564A; Wed, 21 Dec 2011 10:41:32 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:130:3ffc::401:25]) by mx1.freebsd.org (Postfix) with ESMTP id 6879C8FC0C; Wed, 21 Dec 2011 10:41:32 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 2288F25D37D1; Wed, 21 Dec 2011 10:41:31 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 43B92BD7774; Wed, 21 Dec 2011 10:41:30 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id wU6kvB0gSMc9; Wed, 21 Dec 2011 10:41:29 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 3ABB1BD7773; Wed, 21 Dec 2011 10:41:29 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: <4EF1431B.8060909@FreeBSD.org> Date: Wed, 21 Dec 2011 10:41:28 +0000 Content-Transfer-Encoding: 7bit Message-Id: References: <4EF05CEC.6080603@orange.fr> <4EF1431B.8060909@FreeBSD.org> To: Claude Buisson X-Mailer: Apple Mail (2.1084) Cc: stable@freebsd.org, FreeBSD Current Subject: Re: Is the svn2cvs gateway down ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 10:41:32 -0000 On 21. Dec 2011, at 02:23 , Doug Barton wrote: > On 12/20/2011 02:01, Claude Buisson wrote: >> Hi, >> >> It seems (from my own csup's and cvswe.cgi) that the src commits are lost, >> starting with r228697 Sun Dec 18 22:04:55 2011) > > Yeah, my warning 2 days ago that this was going to happen seems to have > gone un-heeded. :) I'm sure you can take bz' word that it's being > looked at now though. It's been fixed and the changes should propagate to cvsup mirrors close to everyone the next two hours. /bz -- Bjoern A. Zeeb You have to have visions! Stop bit received. Insert coin for new address family. From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 11:02:21 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72B63106564A for ; Wed, 21 Dec 2011 11:02:21 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from lo.gmane.org (lo.gmane.org [80.91.229.12]) by mx1.freebsd.org (Postfix) with ESMTP id 2F5828FC08 for ; Wed, 21 Dec 2011 11:02:21 +0000 (UTC) Received: from list by lo.gmane.org with local (Exim 4.69) (envelope-from ) id 1RdJw9-0006Lv-OK for freebsd-stable@freebsd.org; Wed, 21 Dec 2011 12:02:17 +0100 Received: from 161.53.72.45 ([161.53.72.45]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 21 Dec 2011 12:02:17 +0100 Received: from ivoras by 161.53.72.45 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 21 Dec 2011 12:02:17 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Ivan Voras Date: Wed, 21 Dec 2011 12:02:04 +0100 Lines: 25 Message-ID: Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: 161.53.72.45 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 Subject: Unbalanced timer interrupts under VMWare? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 11:02:21 -0000 I have a strange situation on a VMWare 5-hosted machine: # vmstat -i interrupt total rate irq1: atkbd0 74 0 irq6: fdc0 11 0 irq15: ata1 17 0 irq18: em0 42122 1 cpu0:timer 2246291 54 irq256: mpt0 141402 3 cpu1:timer 280800 6 Total 2710717 65 The cpu0 timer interrupt rate is 54 Hz and cpu1 rate is 6 Hz. The same is visible when monitoring the system in real time with "systat -vm". This is a default FreeBSD 9 RC3 amd64 system, HZ is the default 100. Unless the tickless kernel project has advanced more than I think, this looks like a problem... so I looked elsewhere and it turns out I cannot get more than about 55 interrupts/s with the disk controller either. Any ideas? I have another host running VMware 5 but only an 8-stable machine in it, which works fine. Does anyone else run 9.x on VMware 5? The host is a Xeon X3360 CPU (4 cores, no HTT, 2.8 GHz). From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 11:39:12 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C1360106564A; Wed, 21 Dec 2011 11:39:12 +0000 (UTC) (envelope-from hosting@syscare.sk) Received: from services.syscare.sk (services.syscare.sk [188.40.39.36]) by mx1.freebsd.org (Postfix) with ESMTP id 756998FC13; Wed, 21 Dec 2011 11:39:12 +0000 (UTC) Received: from services.syscare.sk (services [188.40.39.36]) by services.syscare.sk (Postfix) with ESMTP id 30089968A6; Wed, 21 Dec 2011 12:20:07 +0100 (CET) X-Virus-Scanned: amavisd-new at rulez.sk Received: from services.syscare.sk ([188.40.39.36]) by services.syscare.sk (services.rulez.sk [188.40.39.36]) (amavisd-new, port 10024) with ESMTP id YP7KBeuKB5AO; Wed, 21 Dec 2011 12:20:01 +0100 (CET) Received: from hosting.syscare.sk (hosting [188.40.39.37]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by services.syscare.sk (Postfix) with ESMTPS id B9A5A96889; Wed, 21 Dec 2011 12:20:01 +0100 (CET) Received: (from www@localhost) by hosting.syscare.sk (8.14.4/8.14.4/Submit) id pBLBK1Xd024814; Wed, 21 Dec 2011 12:20:01 +0100 (CET) (envelope-from hosting@syscare.sk) X-Authentication-Warning: hosting.syscare.sk: www set sender to hosting@syscare.sk using -f To: , , X-PHP-Originating-Script: 0:func.inc MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 21 Dec 2011 12:20:01 +0100 From: Daniel Gerzo Organization: The FreeBSD Project Message-ID: <42b359617666a9ec8b47908964a5ee9e@rulez.sk> X-Sender: danger@FreeBSD.org User-Agent: Roundcube Webmail/0.5.4 Cc: Subject: REMAINDER: Call for FreeBSD Status Reports - 4Q/2011 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 11:39:12 -0000 Dear all, I would like to remind you that the next round of status reports covering the fourth quarter of 2011 are due on January 15th, 2011. As this initiative is very popular among our users, I would like to ask you to submit your status reports as sooner than later (holidays are quickly approaching), so that we can compile the report in a timely fashion. Do not hesitate and write a few lines; a short description about what you are working on, what your plans and goals are, or any other information that you consider interested is always welcome. This way we can inform our community about your great work! Check out the reports from the past to get some inspiration of what your submission should look like. If you know about a project that should be included in the status report, please let us know as well, so we can poke the responsible people to provide us with something useful. Updates to submissions from the last report are welcome as well. Note that the submissions are accepted from anyone involved within the FreeBSD community, you do not have to be a FreeBSD committer. Anything related to FreeBSD can be covered. Please email us the filled-in XML template which can be found at http://www.freebsd.org/news/status/report-sample.xml to monthly@FreeBSD.org, or alternatively use our web based form located at http://www.freebsd.org/cgi/monthly.cgi. For more information, please visit http://www.freebsd.org/news/status/. We are looking forward to see your submissions! -- Kind regards Daniel Gerzo From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 14:04:32 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 415F1106564A; Wed, 21 Dec 2011 14:04:32 +0000 (UTC) (envelope-from mdounin@mdounin.ru) Received: from mdounin.cust.ramtel.ru (mdounin.cust.ramtel.ru [81.19.69.81]) by mx1.freebsd.org (Postfix) with ESMTP id EF2BE8FC08; Wed, 21 Dec 2011 14:04:31 +0000 (UTC) Received: from mdounin.ru (mdounin.cust.ramtel.ru [81.19.69.81]) by mdounin.cust.ramtel.ru (Postfix) with ESMTP id 0EEA917018; Wed, 21 Dec 2011 17:48:52 +0400 (MSK) Date: Wed, 21 Dec 2011 17:48:52 +0400 From: Maxim Dounin To: Ivan Voras Message-ID: <20111221134852.GT67687@mdounin.ru> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: Unbalanced timer interrupts under VMWare? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 14:04:32 -0000 Hello! On Wed, Dec 21, 2011 at 12:02:04PM +0100, Ivan Voras wrote: > I have a strange situation on a VMWare 5-hosted machine: > > # vmstat -i > interrupt total rate > irq1: atkbd0 74 0 > irq6: fdc0 11 0 > irq15: ata1 17 0 > irq18: em0 42122 1 > cpu0:timer 2246291 54 > irq256: mpt0 141402 3 > cpu1:timer 280800 6 > Total 2710717 65 > > The cpu0 timer interrupt rate is 54 Hz and cpu1 rate is 6 Hz. The > same is visible when monitoring the system in real time with "systat > -vm". > > This is a default FreeBSD 9 RC3 amd64 system, HZ is the default 100. > Unless the tickless kernel project has advanced more than I think, It is, actually. Many thanks to mav@ for his amazing work. $ sysctl kern.eventtimer.periodic kern.eventtimer.periodic: 0 $ vmstat -i | grep timer cpu0:timer 72769640 47 And down to 37 i/s as seen in "systat -vm". Idle virtual machine now takes 2 times less CPU on my laptop as seen from the host. > this looks like a problem... so I looked elsewhere and it turns out > I cannot get more than about 55 interrupts/s with the disk > controller either. Happily goes to 6k i/s here (though it's under VirtualBox and a bit old -current, not 9.0). (Just in case: note that vmstat report rate since boot, "systat -vm" may be better to look at current values.) > Any ideas? I have another host running VMware 5 but only an 8-stable > machine in it, which works fine. Does anyone else run 9.x on VMware > 5? > > The host is a Xeon X3360 CPU (4 cores, no HTT, 2.8 GHz). Maxim Dounin From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 14:54:46 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D65271065678 for ; Wed, 21 Dec 2011 14:54:46 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from lo.gmane.org (lo.gmane.org [80.91.229.12]) by mx1.freebsd.org (Postfix) with ESMTP id 93AE88FC15 for ; Wed, 21 Dec 2011 14:54:46 +0000 (UTC) Received: from list by lo.gmane.org with local (Exim 4.69) (envelope-from ) id 1RdNZ7-00069a-72 for freebsd-stable@freebsd.org; Wed, 21 Dec 2011 15:54:45 +0100 Received: from 161.53.72.85 ([161.53.72.85]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 21 Dec 2011 15:54:45 +0100 Received: from ivoras by 161.53.72.85 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 21 Dec 2011 15:54:45 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Ivan Voras Date: Wed, 21 Dec 2011 15:54:30 +0100 Lines: 30 Message-ID: References: <20111221134852.GT67687@mdounin.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: 161.53.72.85 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 In-Reply-To: <20111221134852.GT67687@mdounin.ru> Subject: Re: Unbalanced timer interrupts under VMWare? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 14:54:46 -0000 On 21.12.2011. 14:48, Maxim Dounin wrote: > Hello! > > On Wed, Dec 21, 2011 at 12:02:04PM +0100, Ivan Voras wrote: >> Unless the tickless kernel project has advanced more than I think, > > It is, actually. Many thanks to mav@ for his amazing work. > > $ sysctl kern.eventtimer.periodic > kern.eventtimer.periodic: 0 > > $ vmstat -i | grep timer > cpu0:timer 72769640 47 Ah, great! I missed that commit :) Thanks mav! > And down to 37 i/s as seen in "systat -vm". Idle virtual machine > now takes 2 times less CPU on my laptop as seen from the host. > >> this looks like a problem... so I looked elsewhere and it turns out >> I cannot get more than about 55 interrupts/s with the disk >> controller either. > > Happily goes to 6k i/s here (though it's under VirtualBox and > a bit old -current, not 9.0). Yes, it looks like it's not related to the tickless mode, the disk IO is slow even when kern.eventtimer.periodic=1. Something else is broken. From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 17:03:44 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 784E51065670; Wed, 21 Dec 2011 17:03:44 +0000 (UTC) (envelope-from andrey@zonov.org) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id CA1178FC15; Wed, 21 Dec 2011 17:03:43 +0000 (UTC) Received: by faaf16 with SMTP id f16so5360460faa.13 for ; Wed, 21 Dec 2011 09:03:42 -0800 (PST) Received: by 10.180.96.72 with SMTP id dq8mr15919446wib.10.1324486983655; Wed, 21 Dec 2011 09:03:03 -0800 (PST) Received: from [10.254.254.77] (ppp95-165-154-46.pppoe.spdop.ru. [95.165.154.46]) by mx.google.com with ESMTPS id en10sm2591754wbb.11.2011.12.21.09.03.02 (version=SSLv3 cipher=OTHER); Wed, 21 Dec 2011 09:03:03 -0800 (PST) Message-ID: <4EF21146.9010107@zonov.org> Date: Wed, 21 Dec 2011 21:03:02 +0400 From: Andrey Zonov User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.8.1.24) Gecko/20100228 Thunderbird/2.0.0.24 Mnenhy/0.7.6.0 MIME-Version: 1.0 To: Kostik Belousov References: <4EE7BF77.5000504@zonov.org> <20111213221501.GA85563@icarus.home.lan> <4EE8E6E3.7050202@zonov.org> <20111214182252.GA5176@icarus.home.lan> <4EE8FD3E.8030902@zonov.org> <20111214204201.GA7372@icarus.home.lan> <20111215130111.GN50300@deviant.kiev.zoral.com.ua> In-Reply-To: <20111215130111.GN50300@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: alc@freebsd.org, freebsd-stable@freebsd.org, Jeremy Chadwick Subject: Re: directory listing hangs in "ufs" state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 17:03:44 -0000 On 15.12.2011 17:01, Kostik Belousov wrote: > On Thu, Dec 15, 2011 at 03:51:02PM +0400, Andrey Zonov wrote: >> On Thu, Dec 15, 2011 at 12:42 AM, Jeremy Chadwick >> wrote: >> >>> On Wed, Dec 14, 2011 at 11:47:10PM +0400, Andrey Zonov wrote: >>>> On 14.12.2011 22:22, Jeremy Chadwick wrote: >>>>> On Wed, Dec 14, 2011 at 10:11:47PM +0400, Andrey Zonov wrote: >>>>>> Hi Jeremy, >>>>>> >>>>>> This is not hardware problem, I've already checked that. I also ran >>>>>> fsck today and got no errors. >>>>>> >>>>>> After some more exploration of how mongodb works, I found that then >>>>>> listing hangs, one of mongodb thread is in "biowr" state for a long >>>>>> time. It periodically calls msync(MS_SYNC) accordingly to ktrace >>>>>> out. >>>>>> >>>>>> If I'll remove msync() calls from mongodb, how often data will be >>>>>> sync by OS? >>>>>> >>>>>> -- >>>>>> Andrey Zonov >>>>>> >>>>>> On 14.12.2011 2:15, Jeremy Chadwick wrote: >>>>>>> On Wed, Dec 14, 2011 at 01:11:19AM +0400, Andrey Zonov wrote: >>>>>>>> >>>>>>>> Have you any ideas what is going on? or how to catch the problem? >>>>>>> >>>>>>> Assuming this isn't a file on the root filesystem, try booting the >>>>>>> machine in single-user mode and using "fsck -f" on the filesystem in >>>>>>> question. >>>>>>> >>>>>>> Can you verify there's no problems with the disk this file lives on as >>>>>>> well (smartctl -a /dev/disk)? I'm doubting this is the problem, but >>>>>>> thought I'd mention it. >>>>> >>>>> I have no real answer, I'm sorry. msync(2) indicates it's effectively >>>>> deprecated (see BUGS). It looks like this is effectively a mmap-version >>>>> of fsync(2). >>>> >>>> I replaced msync(2) with fsync(2). Unfortunately, from man pages it >>>> is not obvious that I can do this. Anyway, thanks. >>> >>> Sorry, that wasn't what I was implying. Let me try to explain >>> differently. >>> >>> msync(2) looks, to me, like an mmap-specific version of fsync(2). Based >>> on the man page, it seems that the with msync() you can effectively >>> guaranteed flushing of certain pages within an mmap()'d region to disk. >>> fsync() would flush **all** buffers/internal pages to be flushed to >>> disk. >>> >>> One would need to look at the code to mongodb to find out what it's >>> actually doing with msync(). That is to say, if it's doing something >>> like this (I probably have the semantics wrong -- I've never spent much >>> time with mmap()): >>> >>> fd = open("/some/file", O_RDWR); >>> ptr = mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_SHARED, fd, 0); >>> ret = msync(ptr, 65536, MS_SYNC); >>> /* or alternatively, this: >>> ret = msync(ptr, NULL, MS_SYNC); >>> */ >>> >>> Then this, to me, would be mostly the equivalent to: >>> >>> fd = fopen("/some/file", "r+"); >>> ret = fsync(fd); >>> >>> Otherwise, if it's calling msync() only on an address/location within >>> the region ptr points to, then that may be more efficient (less pages to >>> flush). >>> >> >> They call msync() for the whole file. So, there will not be any difference. >> >> >>> The mmap() arguments -- specifically flags (see man page) -- also play >>> a role here. The one that catches my attention is MAP_NOSYNC. So you >>> may need to look at the mongodb code to figure out what it's mmap() >>> call is. >>> >>> One might wonder why they don't just use open() with the O_SYNC. I >>> imagine that has to do with, again, performance; possibly the don't want >>> all I/O synchronous, and would rather flush certain pages in the mmap'd >>> region to disk as needed. I see the legitimacy in that approach (vs. >>> just using O_SYNC). >>> >>> There's really no easy way for me to tell you which is more efficient, >>> better, blah blah without spending a lot of time with a benchmarking >>> program that tests all of this, *plus* an entire system (world) built >>> with profiling. >>> >> >> I ran for two hours mongodb with fsync() and got the following: >> STARTED INBLK OUBLK MAJFLT MINFLT >> Thu Dec 15 10:34:52 2011 3 192744 314 3080182 >> >> This is output of `ps -o lstart,inblock,oublock,majflt,minflt -U mongodb'. >> >> Then I ran it with default msync(): >> STARTED INBLK OUBLK MAJFLT MINFLT >> Thu Dec 15 12:34:53 2011 0 7241555 79 5401945 >> >> There are also two graphics of disk business [1] [2]. >> >> The difference is significant, in 37 times! That what I expected to get. >> >> In commentaries for vm_object_page_clean() I found this: >> >> * When stuffing pages asynchronously, allow clustering. XXX we need a >> * synchronous clustering mode implementation. >> >> It means for me that msync(MS_SYNC) flush every page on disk in single IO >> transaction. If we multiply 4K and 37 we get 150K. This number is size of >> the single transaction in my experience. >> >> +alc@, kib@ >> >> Am I right? Is there any plan to implement this? > Current buffer clustering code can only do only async writes. In fact, I > am not quite sure what would consitute the sync clustering, because the > ability to delay the write is important to be able to cluster at all. > > Also, I am not sure that lack of clustering is the biggest problem. > IMO, the fact that each write is sync is the first problem there. It > would be quite a work to add the tracking of the issued writes to the > vm_object_page_clean() and down the stack. Esp. due to custom page > write vops in several fses. > > The only guarantee that POSIX requires from msync(MS_SYNC) is that > the writes are finished when the syscall returned, and not that the > writes are done synchronously. Below is the hack which should help if > the msync()ed region contains the mapping of the whole file, since > it is possible to fsync() the file after all writes are scheduled > asynchronous then. It will causes unneeded metadata update, but I think > it would be much faster still. > > > diff --git a/sys/vm/vm_object.c b/sys/vm/vm_object.c > index 250b769..a9de554 100644 > --- a/sys/vm/vm_object.c > +++ b/sys/vm/vm_object.c > @@ -938,7 +938,7 @@ vm_object_sync(vm_object_t object, vm_ooffset_t offset, vm_size_t size, > vm_object_t backing_object; > struct vnode *vp; > struct mount *mp; > - int flags; > + int flags, fsync_after; > > if (object == NULL) > return; > @@ -971,11 +971,26 @@ vm_object_sync(vm_object_t object, vm_ooffset_t offset, vm_size_t size, > (void) vn_start_write(vp,&mp, V_WAIT); > vfslocked = VFS_LOCK_GIANT(vp->v_mount); > vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); > - flags = (syncio || invalidate) ? OBJPC_SYNC : 0; > - flags |= invalidate ? OBJPC_INVAL : 0; > + if (syncio&& !invalidate&& offset == 0&& > + OFF_TO_IDX(size) == object->size) { > + /* > + * If syncing the whole mapping of the file, > + * it is faster to schedule all the writes in > + * async mode, also allowing the clustering, > + * and then wait for i/o to complete. > + */ > + flags = 0; > + fsync_after = TRUE; > + } else { > + flags = (syncio || invalidate) ? OBJPC_SYNC : 0; > + flags |= invalidate ? (OBJPC_SYNC | OBJPC_INVAL) : 0; > + fsync_after = FALSE; > + } > VM_OBJECT_LOCK(object); > vm_object_page_clean(object, offset, offset + size, flags); > VM_OBJECT_UNLOCK(object); > + if (fsync_after) > + (void) VOP_FSYNC(vp, MNT_WAIT, curthread); > VOP_UNLOCK(vp, 0); > VFS_UNLOCK_GIANT(vfslocked); > vn_finished_write(mp); Thanks, this patch works. Performance is the same as of using fsync(). Actually, Linux uses fsync() inside of msync() if MS_SYNC is set. http://git.kernel.org/?p=linux/kernel/git/torvalds/linux.git;a=blob;f=mm/msync.c;h=632df4527c0122062d9332a0d483835274ed62f6;hb=HEAD -- Andrey Zonov From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 18:43:30 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DCF5C106564A for ; Wed, 21 Dec 2011 18:43:30 +0000 (UTC) (envelope-from mailinglists@elfsechsundzwanzig.de) Received: from smtprelay05.ispgateway.de (smtprelay05.ispgateway.de [80.67.31.93]) by mx1.freebsd.org (Postfix) with ESMTP id 9FC2A8FC14 for ; Wed, 21 Dec 2011 18:43:30 +0000 (UTC) Received: from [87.79.168.3] (helo=Lux.localdomain) by smtprelay05.ispgateway.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1RdQvU-0005Uw-CV for freebsd-stable@freebsd.org; Wed, 21 Dec 2011 19:30:04 +0100 Date: Wed, 21 Dec 2011 19:30:08 +0100 (CET) From: 1126 X-X-Sender: 1126@Lux.localdomain To: freebsd-stable@freebsd.org Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Df-Sender: bWFpbGluZ2xpc3RzQGVsZnNlY2hzdW5kendhbnppZy5kZQ== Subject: "required by"? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 18:43:30 -0000 Hello guys! I got a question concerning dependencies.. Is there a method to check what depends on a given port? What do I have to do to check what depends on - say - gconf? I know that there's a way to check what gconf depends on (via checking freshports.org for example), but what about the other way around? Thanks in advance, greetings from Cologne, 1126! From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 18:53:34 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 80A6D106566C for ; Wed, 21 Dec 2011 18:53:34 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id 449B08FC16 for ; Wed, 21 Dec 2011 18:53:34 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id pBLIrU8K016413; Wed, 21 Dec 2011 13:53:30 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <4EF22B22.2040709@sentex.net> Date: Wed, 21 Dec 2011 13:53:22 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: 1126 References: In-Reply-To: X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.71 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-stable@freebsd.org Subject: Re: "required by"? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 18:53:34 -0000 On 12/21/2011 1:30 PM, 1126 wrote: > Hello guys! > > I got a question concerning dependencies.. Is there a method to check > what depends on a given port? What do I have to do to check what depends > on - say - gconf? I know that there's a way to check what gconf depends > on (via checking freshports.org for example), but what about the other > way around? Try pkg_info -r and -R eg pkg_info -R m4-1.4.16,1 Information for m4-1.4.16,1: Required by: autoconf-2.68 automake-1.11.1 bison-2.4.3,1 # pkg_info -r automake-1.11.1 Information for automake-1.11.1: Depends on: Dependency: perl-threaded-5.14.1_3 Dependency: m4-1.4.16,1 Dependency: automake-wrapper-20101119 Dependency: autoconf-wrapper-20101119 Dependency: autoconf-2.68 Another way is described at http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/ports-finding-applications.html ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 18:59:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5C71B1065675; Wed, 21 Dec 2011 18:59:50 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from mail.ebusiness-leidinger.de (mail.ebusiness-leidinger.de [217.11.53.44]) by mx1.freebsd.org (Postfix) with ESMTP id B61A68FC0A; Wed, 21 Dec 2011 18:59:49 +0000 (UTC) Received: from outgoing.leidinger.net (p4FC4361F.dip.t-dialin.net [79.196.54.31]) by mail.ebusiness-leidinger.de (Postfix) with ESMTPSA id 55F0784403D; Wed, 21 Dec 2011 19:42:52 +0100 (CET) Received: from localhost (unknown [85.94.224.19]) by outgoing.leidinger.net (Postfix) with ESMTPSA id 1A97150F0; Wed, 21 Dec 2011 19:42:47 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=Leidinger.net; s=outgoing-alex; t=1324492969; bh=4atfPkeMSYP08jaQLeAsPAUzgPt9uduUQPdLguW35so=; h=Date:Subject:Message-ID:From:To:Cc:MIME-Version:Content-Type; b=nH/sPQat45+bMi41Grr+whSe0zk9MYPI+Ll4LEdACUMlwClXSa8DcdA2hPERD4z2y 0S5DEw4U9f4QcQjlJIqMqiQ0NcArnUysiOuN7DYc3D4GRUGXm3le6KbAUCI1Tzm2Dx y7mKFl9myH4tqNpZGF9hSSjM+SMTOVSeqT92s2NEnPd1/C7prjFLOtw3FTe+5EKZbc 2r220/+haMijMZtSW0MrOgyy+ofjLndWQtg6BMpmj83Ph49Ly0srfCLMB48TaZCYTx M8Ir833nE+lq+2aGSfqILCngLUbl5EwDoYM7sSsj4xJW7wwWibfIElbPVnsaecMZGv rReuxxLek/sOA== Date: Wed, 21 Dec 2011 19:41:47 +0100 Message-ID: Importance: normal From: Alexander Leidinger To: ohartman@zedat.fu-berlin.de, igor@hybrid-lab.co.uk MIME-Version: 1.0 X-EBL-MailScanner-Information: Please contact the ISP for more information X-EBL-MailScanner-ID: 55F0784403D.A2C06 X-EBL-MailScanner: Found to be clean X-EBL-MailScanner-SpamCheck: not spam, spamhaus-ZEN, SpamAssassin (not cached, score=1.401, required 6, autolearn=disabled, ALL_TRUSTED -1.00, DKIM_SIGNED 0.10, DKIM_VALID -0.10, DKIM_VALID_AU -0.10, HTML_MESSAGE 0.00, SARE_ADLTSUB4 2.50) X-EBL-MailScanner-SpamScore: s X-EBL-MailScanner-From: alexander@leidinger.net X-EBL-MailScanner-Watermark: 1325097773.95682@UAS4O1xQyDoZUisA6ZeAIw X-EBL-Spam-Status: No Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-performance@freebsd.org, freebsd-current@freebsd.org, freebsd-stable@freebsd.org, freebsd@jdc.parodius.com Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 18:59:50 -0000 SGksCgp3aGlsZSB0aGUgZGlzY3Vzc2lvbiBjb250aW51ZWQgaGVyZSwgc29tZSB3b3JrIHN0YXJ0 ZWQgYXQgc29tZSBvdGhlciBwbGFjZS4gTm93Li4uIGluIGNhc2Ugc29tZW9uZSBoZXJlIGlzIHdp bGxpbmcgdG8gaGVscCBpbnN0ZWFkIG9mIHRhbGtpbmcsIGZlZWwgZnJlZSB0byBnbyB0byBodHRw Oi8vd2lraS5mcmVlYnNkLm9yZy9CZW5jaG1hcmtBZHZpY2UgYW5kIGhhdmUgYSBsb29rIHdoYXQg Y2FuIGJlIGltcHJvdmVkLiBUaGUgcGFnZSBpcyBmYXIgZnJvbSBwZXJmZWN0IGFuZCBuZWVkcyBz b21lIGFkZGl0aW9uYWwgcGVvcGxlIHdoaWNoIGFyZSB3aWxsaW5nIHRvIGltcHJvdmUgaXQuCgpU aGlzIGlzIG9ubHkgcGFydCBvZiB0aGUgcHJvYmxlbS4gQSB0dW5pbmcgcGFnZSBpbiB0aGUgd2lr aSAtIHdoaWNoIGNvdWxkIGJlIHJlZmVyZW5jZWQgZnJvbSB0aGUgYmVuY2htYXJrIHBhZ2UgLSB3 b3VsZCBiZSBncmVhdCB0b28uIEFueSB2b2x1bnRlZXJzPyBBIGZpcnN0IHN0ZXAgd291bGQgYmUg dG8gdGFrZSBoZSB0dW5pbmctbWFuLXBhZ2UgYW5kIHdpa2lmeSBpdC4gT3RoZXIgdHVuaW5nIHNv dXJjZXMgYXJlIHdlbGNvbWUgdG9vLgoKRXZlcnkgRnJlZUJTRCBkZXYgd2l0aCBhIHdpa2kgYWNj b3VudCBjYW4gaGFuZCBvdXQgd3JpdGUgYWNjZXNzIHRvIHRoZSB3aWtpLiBUaGUgYmVuY2htYXJr IHBhZ2UgZ2l2ZXMgY29udHJpYnV0b3ItYWNjZXNzLiBJZiBzb21lb25lIHdhbnRzIHdyaXRlIGFj Y2VzcyBjcmVhdGUgYSBGaXJzdG5hbWVMYXN0bmFtZSBhY2NvdW50IGFuZCBhc2sgaGVyZSBmb3Ig Y29udHJpYnV0b3ItYWNjZXNzLgoKRG9uJ3Qgd29ycnkgaWYgeW91IHRoaW5rIHlvdXIgZW5nbGlz aCBpcyBub3QgZ29vZCBlbm91Z2gsIGV2ZW4gc29tZSBvbmUtd29yZCBub3RlcyBjYW4gaGVscCAo YW5kIF9teV8gZW5nbGlzaCBnb3QgYWxyZWFkeSBjb3JyZWN0ZWQgYnkgb3RoZXIgcGVvcGxlIG9u IHRoZSBiZW5jaG1hcmsgcGFnZSkuCgpCeWUsCkFsZXhhbmRlci4KCi0tIApTZW5kIHZpYSBhbiBB bmRyb2lkIGRldmljZSwgcGxlYXNlIGZvcmdpdmUgYnJldml0eSBhbmQgdHlwb2dyYXBoaWMgYW5k IHNwZWxsaW5nIGVycm9ycy7CoCJPLiBIYXJ0bWFubiIgPG9oYXJ0bWFuQHplZGF0LmZ1LWJlcmxp bi5kZT4gaGF0IGdlc2NocmllYmVuOk9uIDEyLzIwLzExIDIxOjIwLCBJZ29yIE1vem9sZXZza3kg d3JvdGU6Cj4gSW50ZXJlc3RpbmdseSwgd2hpbGUgcGVvcGxlIHNlZW0gdG8gYmUgKGFyZ3VhYmx5 IHJpZ2h0bHkpIGZvY3VzZWQgb24KPiBjcml0aWNpc2luZyBQaG9yb25peCdzIGJlbmNobWFya2lu Zywgbm9ib2R5IGhhcyBvZmZlcmVkIGFuIGFsdGVybmF0aXZlCj4gYmVuY2htYXJrOyBhbmQgd2hp bGUgKGFnYWluLCBhcmd1YWJseSByaWdodGx5KSBpdCBpcyBpbXBvcnRhbnQgdG8KPiBiZW5jaG1h cmsgcmVhbCB3b3JsZCBwZXJmb3JtYW5jZSwgZXF1YWxseSwgbm9ib2R5IGhhcyBvZmZlcmVkIGFu eQo+IG51bWJlcnMgaW4gcmVsYXRpb24gdG8sIGZvciBleGFtcGxlLCBIVFRQIG9yIFNNVFAsIG9y IGFueSBvdGhlciAicmVhbAo+IHdvcmxkIi1hcHBsaWNhdGlvbiB0b3J0dXJlIHRlc3RzIGRvbmUg b24gdGhlIGFmb3JlbWVudGlvbmVkIHR3bwo+IHBsYXRmb3Jtcy4uLiBJTU8sIHRoaXMganVzdCBn b2VzIHRvIHNob3cgdGhhdCAiZG9pbmcgaXMgaGFyZCIgYW5kCj4gImNyaXRpY2lzaW5nIGlzIG11 Y2ggZWFzaWVyIiAoeWVzLCBJIGFtIGF3YXJlIG9mIHRoZSBpcm9ueSBpbnZvbHZlZCBpbgo+IG1h a2luZyB0aGlzIHN0YXRlbWVudCwgYnV0IHNvbWVvbmUgaGFzIHRvISkKPiAKPiAKPiBDaGVlcnMs Cj4gSWdvciBNIDotKQoKVW5mb3J0dW5hdGVseSwgTS4gTGFyYWJlbCBpcyB0aGUgb25seSBvbmUg d2hvJ3MgcGVyZm9ybWluZyBiZW5jaG1hcmtzIG9uCkZyZWVCU0QsIGNvbXBhcmluZyBpdHMgcGVy Zm9ybWFuY2UgdG8gdGhlIExpbnV4LW9wcG9uZW50cy4gQWRuIGluZGVlZCwKdGhlcmUgaXMgYSBs b3Qgb2YgY3JpdGljaXNtLCBidXQgbm8gYWx0ZXJuYXRpdmUuCkkgc2FpZCB1bmZvcnR1bmF0ZWx5 IC0gbm90IG9mZmVuc2l2ZSAtIHNpbmNlIExhcmFiZWwgYW5kIFBob3Jvbml4IGFyZQpzYWRseSB0 aGUgb25seSBvbmVzIHdobyBkbyBhY3R1YWxseSBzdWNoIGJlY2htYXJraW5nLgoKSXQgd291bGQg YmUgbXVjaCBtb3JlIG5pY2VyIGFuZCBraW5kIHRvIHN1cHBvcnQgdGhvc2UgcGVvcGxlLgoKV2Vs bCwgaW4gSmFudWFyeS9GZWJydWFyeSB3ZSBnZXQgbmV3IGhhcmR3YXJlLiBPbmUgYm94IGlzIHN1 cHBvc2VkIHRvIGRvCm51bWJlciBjcnVuY2hpbmcgdmlhIDEyIGNvcmVzIGFuZCBhIFRFU0xBIEdQ VS4gTXkgY29sbGVhZ3VlIGlzCmRldmVsb3BpbmcgYSBoaWdoIHBhcmFsbGVsaXplZCBwZWljZSBv ZiBzb2Z0d2FyZSBmb3Igc2F0ZWxsaXRlIGRhdGEKdHJhbnNmb3JtYXRpb24uIFRoZSBzb2Z0d2Fy ZSBwYWNrYWdlIGlzIENQVSBib3VuZCwgcGFydGlhbGx5IEdQVSwgYnV0Cm1hc3NpdmVseSBtZW1v cnkgaHVuZ3J5ICg5NiB0byAxMjggR0IgUkFNIGlzIG5lZWRlZCkuCldoYXQgSSBjYW4gb2ZmZXIg aXMsIHNpbmNlIEkgd2lsbCBhbHNvIHdvcmsgb24gdGhhdCBtYWNoaW5lIGFuZCBJJ3ZlCmZyZWUg aGFuZCB0byBhZG1pbmlzdGVyLCBpbiB0aGUgc3BhcmUgdGltZSBvZiBkb2luZyBteSBQaEQsIGlu c3RhbGxpbmcKRnJlZUJTRCA5LjAvMTAuMCBiZXNpZGVzIFN1U2UgTGludXggYW5kIGxvb2tpbmcg Zm9yd2FyZCBoYXZpbmcgb25lIFpGUwpkYXRhIHN0b3JhZ2UgZHJpdmUgZm9yIGhvbWVzLCBzbyBi b3RoIHN5c3RlbXMgY2FuIHBlcmZvcm0gb24gYSBtb3N0CnJlY2VudCBaRlMuIEknbSBuZXcgdG8g TGludXgsIG5vdCBhIEJTRCBndXJ1LCBub3IgSSdtIGEgcHJvZmVzc2lvbmFsCnByb2dyYW1tZXIv ZGV2ZWxvcGVyLiBNeSBza2lsbHMgYXJlIHN1ZmZpY2llbnQgZm9yIHRoZSBkYWlseSBzY2llbnRp ZmljCndvcmsuIFNvLCB3aXRob3V0IHByZXNzdXJlLCBJJ20gd2lsbGluZyB0byBwZXJmb3JtIHNv bWUgSFBDIGJlbmNobWFya3MKdW5kZXIgYWR2aWNlIGlmIHRoZSBkYXkgY29tZXMgYW5kIHRob3Nl IGludGVyZXN0ZWQgaW4gYmFyZSBudW1iZXJzIG9mCkZyZWVCU0QgdnMuIExpbnV4IHBlcmZvcm1h bmNlIHdpdGggYSByZWFsLXdvcmxkLXNjaWVudGlmaWMgYXBwbGljYXRpb24uCgpJIHdvdWxkIGFw cHJlY2lhdGUgdG8gc2VlIHNvbWUgb2YgdGhlIGRldmVsb3BlcnMgYW5kL29yIEZyZWVCU0QgaGFj a2Vycwp0byBoZWxwIFBob3Jvbml4IHNldHRpbmcgdXAgYSBwcm9wZXIgdGVzdGVudmlyb25tZW50 IGluc3RlYWQgb2YgYmFzaGluZwpNLiBMYXJhYmVsIGFuZCBoaXMgZmVsbG93cy4KClJlZ2FyZHMs Ck9saXZlcgoK From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 19:06:32 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 58689106564A for ; Wed, 21 Dec 2011 19:06:32 +0000 (UTC) (envelope-from freebsd@chillt.de) Received: from dd28124.kasserver.com (dd28124.kasserver.com [85.13.146.180]) by mx1.freebsd.org (Postfix) with ESMTP id 1B0BE8FC1C for ; Wed, 21 Dec 2011 19:06:31 +0000 (UTC) Received: from taiko.lan (82.131.56.111.cable.starman.ee [82.131.56.111]) by dd28124.kasserver.com (Postfix) with ESMTPSA id DBC351D80212; Wed, 21 Dec 2011 19:50:37 +0100 (CET) Message-ID: <4EF22A62.8090508@chillt.de> Date: Wed, 21 Dec 2011 20:50:10 +0200 From: Bartosz Fabianowski User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111108 Thunderbird/8.0 MIME-Version: 1.0 To: 1126 References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: "required by"? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 19:06:32 -0000 Once you have a port installed, "pkg_info -R gconf\*" will tell you. - Bartosz From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 19:36:14 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C615B1065673 for ; Wed, 21 Dec 2011 19:36:14 +0000 (UTC) (envelope-from boydjd@jbip.net) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 59C7B8FC17 for ; Wed, 21 Dec 2011 19:36:13 +0000 (UTC) Received: by eaaf13 with SMTP id f13so9837821eaa.13 for ; Wed, 21 Dec 2011 11:36:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jbip.net; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=rfXe09YDz5lKGijqCIjp4WA3eZ/ETTBqcUSm25Io7sI=; b=LEX3E4DD1qAA9BGN6e3C1yrgMkiW0OBz6uHWwHQjQbyrGSEfG4F+LLi1IrIS7tRq77 oAJ20BjU09+woTGy1cT5Pwc0XkqNtJZP7NXJRMKms7y5hRJ2EkT1qyBRoKqKfr+f6+WV V07rZMyBja1xWrjl2QEt7QkdZZGvvyhGsi+Hw= Received: by 10.204.38.16 with SMTP id z16mr2519852bkd.66.1324495840298; Wed, 21 Dec 2011 11:30:40 -0800 (PST) MIME-Version: 1.0 Received: by 10.204.98.202 with HTTP; Wed, 21 Dec 2011 11:30:19 -0800 (PST) In-Reply-To: References: From: Joshua Boyd Date: Wed, 21 Dec 2011 14:30:19 -0500 Message-ID: To: freebsd-stable Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 19:36:14 -0000 On Wed, Dec 21, 2011 at 2:22 PM, Joshua Boyd wrote: > Thanks. > Nevermind. This "new" work computer is 64 bit but doesn't have the right chipset features to support 64bit guests. Lame. Sorry for the noise. -- Joshua Boyd E-mail: boydjd@jbip.net http://www.jbip.net From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 19:54:21 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CC234106564A for ; Wed, 21 Dec 2011 19:54:21 +0000 (UTC) (envelope-from boydjd@jbip.net) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 642598FC15 for ; Wed, 21 Dec 2011 19:54:20 +0000 (UTC) Received: by eaaf13 with SMTP id f13so9855448eaa.13 for ; Wed, 21 Dec 2011 11:54:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jbip.net; s=google; h=mime-version:from:date:message-id:subject:to:content-type; bh=JY78jBGK6kcBzikl7qVkk94lG/cbF4sZTycuzKkKhPI=; b=Y0343b8Qy/FYyCDUNT37pnVmY5l/PXBg4q9g/2YwNb/zXLLRuFWFWkRDU3RhdpGcp4 YRC0OWoHH4oVJe4tQSn5A+XXiJQu6lmqjtnVZguqdWArdv/LcMo0NK783grboMjR8n5v va4yf9OGPcnPkQvsXCR8qyk6DZvAL0r6m0wvc= Received: by 10.204.154.208 with SMTP id p16mr2568471bkw.12.1324495398348; Wed, 21 Dec 2011 11:23:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.204.98.202 with HTTP; Wed, 21 Dec 2011 11:22:57 -0800 (PST) From: Joshua Boyd Date: Wed, 21 Dec 2011 14:22:57 -0500 Message-ID: To: freebsd-stable Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 19:54:21 -0000 I'm unable to install RC3 on VirtualBox, I receive the following error: CPU doesn't support long mode > > Consoles: internal video/keyboard > BIOS drive C: is disk0 > BIOS 639kB/1047552kB available memory > > FreeBSD/x86 bootstrap loader, Revision 1.1 > (root@farrell.cse.buffalo.edu, Sun Dec 4 07:50:52 UTC 2011) > Can't work out which disk we are booting from. > Guess BIOS device 0xffffffff not found by probes, defaulting to disk0: > FATAL: int13_harddisk: function 42. Can't use 64bits lba > I've tried a few different controller combinations (SAS/SATA/IDE), but none seem to fix the problem. Any help would be cool. Thanks. -- Joshua Boyd E-mail: boydjd@jbip.net http://www.jbip.net From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 20:16:07 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA923106564A for ; Wed, 21 Dec 2011 20:16:07 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 3B8088FC0A for ; Wed, 21 Dec 2011 20:16:06 +0000 (UTC) Received: by eekc50 with SMTP id c50so9361286eek.13 for ; Wed, 21 Dec 2011 12:16:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=sGI/Ixet6zbVA9atdd6J7auXD5gn97Q/oCu/rhMecs0=; b=Ag2XLdiOVldzquecX7QANJzXkPo5c/tSBHrwFwml/JThoeChQ9CIwoigFuXlF3sUyH eWleeDkJFB3Y2SJuK3ety50GyqR8aRw1NNmjaiBteKPLVm67iA5WIw9WauGZRoiSY0/J vbtQLbrN8m05agHYFaypKazfDygjW7/Nojc8k= Received: by 10.213.32.193 with SMTP id e1mr1635327ebd.143.1324498565943; Wed, 21 Dec 2011 12:16:05 -0800 (PST) Received: from [192.168.1.12] (5ED0E470.cm-7-1d.dynamic.ziggo.nl. [94.208.228.112]) by mx.google.com with ESMTPS id j20sm24504451eej.8.2011.12.21.12.16.03 (version=SSLv3 cipher=OTHER); Wed, 21 Dec 2011 12:16:04 -0800 (PST) Message-ID: <4EF23E80.7090507@gmail.com> Date: Wed, 21 Dec 2011 21:16:00 +0100 From: Johan Hendriks User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Joshua Boyd , freebsd-stable References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 20:16:07 -0000 Joshua Boyd schreef: > On Wed, Dec 21, 2011 at 2:22 PM, Joshua Boyd wrote: > >> Thanks. >> > Nevermind. This "new" work computer is 64 bit but doesn't have the right > chipset features to support 64bit guests. > > Lame. > > Sorry for the noise. > > Sometimes a new BIOS version get the needed 64bits virtual support! regards, Johan Hendriks From owner-freebsd-stable@FreeBSD.ORG Wed Dec 21 20:53:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18BD9106566C for ; Wed, 21 Dec 2011 20:53:11 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id C97058FC14 for ; Wed, 21 Dec 2011 20:53:10 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id pBLKr9mB043312; Wed, 21 Dec 2011 15:53:09 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <4EF2472D.20501@sentex.net> Date: Wed, 21 Dec 2011 15:53:01 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Joshua Boyd References: In-Reply-To: X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.71 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-stable Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 20:53:11 -0000 On 12/21/2011 2:22 PM, Joshua Boyd wrote: > I'm unable to install RC3 on VirtualBox, I receive the following error: > > CPU doesn't support long mode >> >> Consoles: internal video/keyboard >> BIOS drive C: is disk0 >> BIOS 639kB/1047552kB available memory >> >> FreeBSD/x86 bootstrap loader, Revision 1.1 >> (root@farrell.cse.buffalo.edu, Sun Dec 4 07:50:52 UTC 2011) >> Can't work out which disk we are booting from. >> Guess BIOS device 0xffffffff not found by probes, defaulting to disk0: >> FATAL: int13_harddisk: function 42. Can't use 64bits lba >> > > I've tried a few different controller combinations (SAS/SATA/IDE), but none > seem to fix the problem. > > Any help would be cool. Actually, I got the same thing with RC3 the other day. But I went to try again just now and it worked. I used FreeBSD-9.0-RC3-amd64-bootonly.iso and it worked just fine. Since the first time I did install the latest version of Virtual box so not sure what changed in there, or it was something else. But the machine its on is running Windows 2008, so it did support amd64 when I had the failure. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 00:52:53 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9FCDF106564A; Thu, 22 Dec 2011 00:52:53 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id 71D888FC13; Thu, 22 Dec 2011 00:52:53 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBM0qqCH024878; Wed, 21 Dec 2011 16:52:52 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBM0qpsu024877; Wed, 21 Dec 2011 16:52:51 -0800 (PST) (envelope-from sgk) Date: Wed, 21 Dec 2011 16:52:50 -0800 From: Steve Kargl To: Attilio Rao Message-ID: <20111222005250.GA23115@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 00:52:53 -0000 On Fri, Dec 16, 2011 at 12:14:24PM +0100, Attilio Rao wrote: > 2011/12/15 Steve Kargl : > > On Thu, Dec 15, 2011 at 05:25:51PM +0100, Attilio Rao wrote: > >> > >> I basically went through all the e-mail you just sent and identified 4 > >> real report on which we could work on and summarizied in the attached > >> Excel file. > >> I'd like that George, Steve, Doug, Andrey and Mike possibly review the > >> few datas there and add more, if they want, or make more important > >> clarifications in particular about the Xorg presence (or rather not) > >> in their workload. > > > > Your summary of my observations appears correct. > > > > I have grabbed an up-to-date /usr/src, built and > > installed world, and built and installed a new > > kernel on one of the nodes in my cluster. ??It > > has > > > > It seems a perfect environment, just please make sure you made a > debug-free userland (setting MALLOC_PRODUCTION in jemalloc basically). > > The first thing is, can you try reproducing your case? As far as I got > it, for you it was enough to run N + small_amount of CPU-bound threads > to show performance penalty, so I'd ask you to start with using dnetc > or just your preferred cpu-bound workload and verify you can reproduce > the issue. > As it happens, please monitor the threads bouncing and CPU utilization > via 'top' (you don't need to be 100% precise, jut to get an idea, and > keep an eye on things like excessive threads migration, thread binding > obsessity, low throughput on CPU). > One note: if your workloads need to do I/O please use a tempfs or > memory storage to do so, in order to reduce I/O effects at all. > Also, verify this doesn't happen with 4BSD scheduler, just in case. > > Finally, if the problem is still in place, please recompile your > kernel by adding: > options KTR > options KTR_ENTRIES=262144 > options KTR_COMPILE=(KTR_SCHED) > options KTR_MASK=(KTR_SCHED) > > And reproduce the issue. > When you are in the middle of the scheduling issue go with: > # ktrdump -ctf > ktr-ule-problem-YOURNAME.out > > and send to the mailing list along with your dmesg and the > informations on the CPU utilization you gathered by top(1). > > That should cover it all, but if you have further questions, please > just go ahead. Attilio, I have placed several files at http://troutmask.apl.washington.edu/~kargl/freebsd dmesg.txt --> dmesg for ULE kernel summary --> A summary that includes top(1) output of all runs. sysctl.ule.txt --> sysctl -a for the ULE kernel ktr-ule-problem-kargl.out.gz I performed a series of tests with both 4BSD and ULE kernels. The 4BSD and ULE kernels are identical except of course for the scheduler. Both witness and invariants are disabled, and malloc has been compiled without debugging. Here's what I did. On the master node in my cluster, I ran an OpenMPI code that sends N jobs off to the node with the kernel of interest. There is communication between the master and slaves to generate 16 independent chunks of data. Note, there is no disk IO. So, for example, N=4 will start 4 essentially identical numerically intensity jobs. At the start of a run, the master node instructs each slave job to create a chunk of data. After the data is created, the slave sends it back to the master and the master sends instructions to create the next chunk of data. This communication continues until the 16 chunks have been assigned, computed, and returned to the master. Here is a rough measurement of the problem with ULE and numerical intensity loads. This command is executed on the master time mpiexec -machinefile mf3 -np N sasmp sas.in Since time is executed on the master, only the 'real' time is of interest (the summary file includes user and sys times). This command is run at 5 times for each N value and up to 10 time for some N values with the ULE kernel. The following table records the average 'real' time and the number in (...) is the mean absolute deviations. # N ULE 4BSD # ------------------------------------- # 4 223.27 (0.502) 221.76 (0.551) # 5 404.35 (73.82) 270.68 (0.866) # 6 627.56 (173.0) 247.23 (1.442) # 7 475.53 (84.07) 285.78 (1.421) # 8 429.45 (134.9) 223.64 (1.316) These numbers to me demonstrate that ULE is not a good choice for a HPC workload. If you need more information, feel free to ask. If you would like access to the node, I can probably arrange that. But, we can discuss that off-line. -- Steve From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 03:13:52 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09524106567E for ; Thu, 22 Dec 2011 03:13:52 +0000 (UTC) (envelope-from perryh@pluto.rain.com) Received: from agora.rdrop.com (agora.rdrop.com [IPv6:2607:f678:1010::34]) by mx1.freebsd.org (Postfix) with ESMTP id D616B8FC17 for ; Thu, 22 Dec 2011 03:13:51 +0000 (UTC) Received: from agora.rdrop.com (66@localhost [127.0.0.1]) by agora.rdrop.com (8.13.1/8.12.7) with ESMTP id pBM3DpJ4049852 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 21 Dec 2011 19:13:51 -0800 (PST) (envelope-from perryh@pluto.rain.com) Received: (from uucp@localhost) by agora.rdrop.com (8.13.1/8.12.9/Submit) with UUCP id pBM3DpZ0049851; Wed, 21 Dec 2011 19:13:51 -0800 (PST) Received: from fbsd81 ([192.168.200.81]) by pluto.rain.com (4.1/SMI-4.1-pluto-M2060407) id AA03450; Wed, 21 Dec 11 19:08:13 PST Date: Thu, 22 Dec 2011 02:07:12 -0800 From: perryh@pluto.rain.com To: boydjd@jbip.net Message-Id: <4ef30150.UsYssF5rUpg9gPJJ%perryh@pluto.rain.com> References: In-Reply-To: User-Agent: nail 11.25 7/29/05 Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 03:13:52 -0000 Joshua Boyd wrote: > This "new" work computer is 64 bit but doesn't have the right > chipset features to support 64bit guests. > > Lame. Perhaps that sort of machine should be referred to as 63-bit, since it is a bit short of full 64-bit capability :) [ducks & runs] From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 04:56:13 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89FDA106564A for ; Thu, 22 Dec 2011 04:56:13 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 139BB8FC08 for ; Thu, 22 Dec 2011 04:56:12 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so15335292wgb.31 for ; Wed, 21 Dec 2011 20:56:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=uAv3VzkNudQUKdPijLSg/Aj2hCl4BonogG5qAeZEU8Y=; b=ZUG0GorDP+Iny4ZSNaqxh2IAoZy2ZoWp2QzCHpqrVepOdgV48hmaa5OdmkbQKzNXzK CvT1R2MSCI6Z4yKE9rPaJ1j+dxgL2tdX2YD1JISU7nZM1WS9w2eZD+r1ETjdw9MPhZsX 7KTk4B6agSfi9f+5hL3wN0ZNrr8AgmHMIvNME= MIME-Version: 1.0 Received: by 10.227.206.129 with SMTP id fu1mr8974779wbb.22.1324529772023; Wed, 21 Dec 2011 20:56:12 -0800 (PST) Received: by 10.223.156.132 with HTTP; Wed, 21 Dec 2011 20:56:11 -0800 (PST) In-Reply-To: References: Date: Wed, 21 Dec 2011 22:56:11 -0600 Message-ID: From: Adam Vande More To: Joshua Boyd Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 04:56:13 -0000 On Wed, Dec 21, 2011 at 1:30 PM, Joshua Boyd wrote: > On Wed, Dec 21, 2011 at 2:22 PM, Joshua Boyd wrote: > > > Thanks. > > > > Nevermind. This "new" work computer is 64 bit but doesn't have the right > chipset features to support 64bit guests. > > Lame. > > Sorry for the noise. > VT-x(or the AMD equiv) is a CPU feature and is necessary to run 64-bit guests. VT-d(or the AMD equiv)/IOMMU is the what is done in the chipset however it isn't necessary to run 64-bit guests. Both of these features are only found on CPU's supporting long mode. -- Adam Vande More From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 09:08:00 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CC0F9106566C; Thu, 22 Dec 2011 09:08:00 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 53A0E8FC17; Thu, 22 Dec 2011 09:08:00 +0000 (UTC) Received: by vcbfk1 with SMTP id fk1so11310518vcb.13 for ; Thu, 22 Dec 2011 01:07:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=BFHDVlT/kICbC3GkTRTpeOyjPAiFIv8HCU7V+QP37Zw=; b=kvBBjSgbgG+aMLNcgz88F31xIyka0Hoqe2AszRDSPtf2Noi4+XWTIH017MtcjKap5G +7qyLyWLBE5havidcAJXlytasSnMD2Bm7s2byp6YzFzShAge6ayt42UetCkj1/qNZjaw 6ftrMaekQO6PHq0F4i0SwKtCjJDr4wmJ5NzkM= MIME-Version: 1.0 Received: by 10.52.22.193 with SMTP id g1mr2120727vdf.77.1324544879095; Thu, 22 Dec 2011 01:07:59 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.158.104 with HTTP; Thu, 22 Dec 2011 01:07:58 -0800 (PST) In-Reply-To: <20111222005250.GA23115@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> Date: Thu, 22 Dec 2011 01:07:58 -0800 X-Google-Sender-Auth: 2iowPw7r6ScXngE2X2QfLuZUfRU Message-ID: From: Adrian Chadd To: Steve Kargl Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Attilio Rao , Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 09:08:00 -0000 Are you able to go through the emails here and grab out Attilio's example for generating KTR scheduler traces? Adrian On 21 December 2011 16:52, Steve Kargl w= rote: > On Fri, Dec 16, 2011 at 12:14:24PM +0100, Attilio Rao wrote: >> 2011/12/15 Steve Kargl : >> > On Thu, Dec 15, 2011 at 05:25:51PM +0100, Attilio Rao wrote: >> >> >> >> I basically went through all the e-mail you just sent and identified = 4 >> >> real report on which we could work on and summarizied in the attached >> >> Excel file. >> >> I'd like that George, Steve, Doug, Andrey and Mike possibly review th= e >> >> few datas there and add more, if they want, or make more important >> >> clarifications in particular about the Xorg presence (or rather not) >> >> in their workload. >> > >> > Your summary of my observations appears correct. >> > >> > I have grabbed an up-to-date /usr/src, built and >> > installed world, and built and installed a new >> > kernel on one of the nodes in my cluster. ??It >> > has >> > >> >> It seems a perfect environment, just please make sure you made a >> debug-free userland (setting MALLOC_PRODUCTION in jemalloc basically). >> >> The first thing is, can you try reproducing your case? As far as I got >> it, for you it was enough to run N + small_amount of CPU-bound threads >> to show performance penalty, so I'd ask you to start with using dnetc >> or just your preferred cpu-bound workload and verify you can reproduce >> the issue. >> As it happens, please monitor the threads bouncing and CPU utilization >> via 'top' (you don't need to be 100% precise, jut to get an idea, and >> keep an eye on things like excessive threads migration, thread binding >> obsessity, low throughput on CPU). >> One note: if your workloads need to do I/O please use a tempfs or >> memory storage to do so, in order to reduce I/O effects at all. >> Also, verify this doesn't happen with 4BSD scheduler, just in case. >> >> Finally, if the problem is still in place, please recompile your >> kernel by adding: >> options KTR >> options KTR_ENTRIES=3D262144 >> options KTR_COMPILE=3D(KTR_SCHED) >> options KTR_MASK=3D(KTR_SCHED) >> >> And reproduce the issue. >> When you are in the middle of the scheduling issue go with: >> # ktrdump -ctf > ktr-ule-problem-YOURNAME.out >> >> and send to the mailing list along with your dmesg and the >> informations on the CPU utilization you gathered by top(1). >> >> That should cover it all, but if you have further questions, please >> just go ahead. > > Attilio, > > I have placed several files at > > http://troutmask.apl.washington.edu/~kargl/freebsd > > dmesg.txt =A0 =A0 =A0--> dmesg for ULE kernel > summary =A0 =A0 =A0 =A0--> A summary that includes top(1) output of all r= uns. > sysctl.ule.txt --> sysctl -a for the ULE kernel > ktr-ule-problem-kargl.out.gz > > I performed a series of tests with both 4BSD and ULE kernels. > The 4BSD and ULE kernels are identical except of course for the > scheduler. =A0Both witness and invariants are disabled, and malloc > has been compiled without debugging. > > Here's what I did. =A0On the master node in my cluster, I ran an > OpenMPI code that sends N jobs off to the node with the kernel > of interest. =A0There is communication between the master and > slaves to generate 16 independent chunks of data. =A0Note, there > is no disk IO. =A0So, for example, N=3D4 will start 4 essentially > identical numerically intensity jobs. =A0At the start of a run, > the master node instructs each slave job to create a chunk of > data. =A0After the data is created, the slave sends it back to the > master and the master sends instructions to create the next chunk > of data. =A0This communication continues until the 16 chunks have > been assigned, computed, and returned to the master. > > Here is a rough measurement of the problem with ULE and numerical > intensity loads. =A0This command is executed on the master > > time mpiexec -machinefile mf3 -np N sasmp sas.in > > Since time is executed on the master, only the 'real' time is of > interest (the summary file includes user and sys times). =A0This > command is run at 5 times for each N value and up to 10 time for > some N values with the ULE kernel. =A0The following table records > the average 'real' time and the number in (...) is the mean > absolute deviations. > > # =A0N =A0 =A0 =A0 =A0 ULE =A0 =A0 =A0 =A0 =A0 =A0 4BSD > # ------------------------------------- > # =A04 =A0 =A0223.27 (0.502) =A0 221.76 (0.551) > # =A05 =A0 =A0404.35 (73.82) =A0 270.68 (0.866) > # =A06 =A0 =A0627.56 (173.0) =A0 247.23 (1.442) > # =A07 =A0 =A0475.53 (84.07) =A0 285.78 (1.421) > # =A08 =A0 =A0429.45 (134.9) =A0 223.64 (1.316) > > These numbers to me demonstrate that ULE is not a good choice > for a HPC workload. > > If you need more information, feel free to ask. =A0If you would > like access to the node, I can probably arrange that. =A0But, > we can discuss that off-line. > > -- > Steve > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 09:49:15 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0479B1065672; Thu, 22 Dec 2011 09:49:15 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id 61EA68FC08; Thu, 22 Dec 2011 09:49:13 +0000 (UTC) Received: from alf.home (alf.kiev.zoral.com.ua [10.1.1.177]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id pBM9mbbO085795 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 22 Dec 2011 11:48:37 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from alf.home (kostik@localhost [127.0.0.1]) by alf.home (8.14.5/8.14.5) with ESMTP id pBM9mbNM081215; Thu, 22 Dec 2011 11:48:37 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by alf.home (8.14.5/8.14.5/Submit) id pBM9maFe081214; Thu, 22 Dec 2011 11:48:36 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: alf.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 22 Dec 2011 11:48:36 +0200 From: Kostik Belousov To: Andrey Zonov Message-ID: <20111222094836.GD50300@deviant.kiev.zoral.com.ua> References: <4EE7BF77.5000504@zonov.org> <20111213221501.GA85563@icarus.home.lan> <4EE8E6E3.7050202@zonov.org> <20111214182252.GA5176@icarus.home.lan> <4EE8FD3E.8030902@zonov.org> <20111214204201.GA7372@icarus.home.lan> <20111215130111.GN50300@deviant.kiev.zoral.com.ua> <4EF21146.9010107@zonov.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="eA/EPO+dPjTdWiw1" Content-Disposition: inline In-Reply-To: <4EF21146.9010107@zonov.org> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-3.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: alc@freebsd.org, freebsd-stable@freebsd.org, Jeremy Chadwick Subject: Re: directory listing hangs in "ufs" state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 09:49:15 -0000 --eA/EPO+dPjTdWiw1 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Dec 21, 2011 at 09:03:02PM +0400, Andrey Zonov wrote: > On 15.12.2011 17:01, Kostik Belousov wrote: > >On Thu, Dec 15, 2011 at 03:51:02PM +0400, Andrey Zonov wrote: > >>On Thu, Dec 15, 2011 at 12:42 AM, Jeremy Chadwick > >>wrote: > >> > >>>On Wed, Dec 14, 2011 at 11:47:10PM +0400, Andrey Zonov wrote: > >>>>On 14.12.2011 22:22, Jeremy Chadwick wrote: > >>>>>On Wed, Dec 14, 2011 at 10:11:47PM +0400, Andrey Zonov wrote: > >>>>>>Hi Jeremy, > >>>>>> > >>>>>>This is not hardware problem, I've already checked that. I also ran > >>>>>>fsck today and got no errors. > >>>>>> > >>>>>>After some more exploration of how mongodb works, I found that then > >>>>>>listing hangs, one of mongodb thread is in "biowr" state for a long > >>>>>>time. It periodically calls msync(MS_SYNC) accordingly to ktrace > >>>>>>out. > >>>>>> > >>>>>>If I'll remove msync() calls from mongodb, how often data will be > >>>>>>sync by OS? > >>>>>> > >>>>>>-- > >>>>>>Andrey Zonov > >>>>>> > >>>>>>On 14.12.2011 2:15, Jeremy Chadwick wrote: > >>>>>>>On Wed, Dec 14, 2011 at 01:11:19AM +0400, Andrey Zonov wrote: > >>>>>>>> > >>>>>>>>Have you any ideas what is going on? or how to catch the problem? > >>>>>>> > >>>>>>>Assuming this isn't a file on the root filesystem, try booting the > >>>>>>>machine in single-user mode and using "fsck -f" on the filesystem = in > >>>>>>>question. > >>>>>>> > >>>>>>>Can you verify there's no problems with the disk this file lives o= n=20 > >>>>>>>as > >>>>>>>well (smartctl -a /dev/disk)? I'm doubting this is the problem, b= ut > >>>>>>>thought I'd mention it. > >>>>> > >>>>>I have no real answer, I'm sorry. msync(2) indicates it's effective= ly > >>>>>deprecated (see BUGS). It looks like this is effectively a=20 > >>>>>mmap-version > >>>>>of fsync(2). > >>>> > >>>>I replaced msync(2) with fsync(2). Unfortunately, from man pages it > >>>>is not obvious that I can do this. Anyway, thanks. > >>> > >>>Sorry, that wasn't what I was implying. Let me try to explain > >>>differently. > >>> > >>>msync(2) looks, to me, like an mmap-specific version of fsync(2). Bas= ed > >>>on the man page, it seems that the with msync() you can effectively > >>>guaranteed flushing of certain pages within an mmap()'d region to disk. > >>>fsync() would flush **all** buffers/internal pages to be flushed to > >>>disk. > >>> > >>>One would need to look at the code to mongodb to find out what it's > >>>actually doing with msync(). That is to say, if it's doing something > >>>like this (I probably have the semantics wrong -- I've never spent much > >>>time with mmap()): > >>> > >>>fd =3D open("/some/file", O_RDWR); > >>>ptr =3D mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_SHARED, fd, 0); > >>>ret =3D msync(ptr, 65536, MS_SYNC); > >>>/* or alternatively, this: > >>>ret =3D msync(ptr, NULL, MS_SYNC); > >>>*/ > >>> > >>>Then this, to me, would be mostly the equivalent to: > >>> > >>>fd =3D fopen("/some/file", "r+"); > >>>ret =3D fsync(fd); > >>> > >>>Otherwise, if it's calling msync() only on an address/location within > >>>the region ptr points to, then that may be more efficient (less pages = to > >>>flush). > >>> > >> > >>They call msync() for the whole file. So, there will not be any=20 > >>difference. > >> > >> > >>>The mmap() arguments -- specifically flags (see man page) -- also play > >>>a role here. The one that catches my attention is MAP_NOSYNC. So you > >>>may need to look at the mongodb code to figure out what it's mmap() > >>>call is. > >>> > >>>One might wonder why they don't just use open() with the O_SYNC. I > >>>imagine that has to do with, again, performance; possibly the don't wa= nt > >>>all I/O synchronous, and would rather flush certain pages in the mmap'd > >>>region to disk as needed. I see the legitimacy in that approach (vs. > >>>just using O_SYNC). > >>> > >>>There's really no easy way for me to tell you which is more efficient, > >>>better, blah blah without spending a lot of time with a benchmarking > >>>program that tests all of this, *plus* an entire system (world) built > >>>with profiling. > >>> > >> > >>I ran for two hours mongodb with fsync() and got the following: > >>STARTED INBLK OUBLK MAJFLT MINFLT > >>Thu Dec 15 10:34:52 2011 3 192744 314 3080182 > >> > >>This is output of `ps -o lstart,inblock,oublock,majflt,minflt -U mongod= b'. > >> > >>Then I ran it with default msync(): > >>STARTED INBLK OUBLK MAJFLT MINFLT > >>Thu Dec 15 12:34:53 2011 0 7241555 79 5401945 > >> > >>There are also two graphics of disk business [1] [2]. > >> > >>The difference is significant, in 37 times! That what I expected to ge= t. > >> > >>In commentaries for vm_object_page_clean() I found this: > >> > >> * When stuffing pages asynchronously, allow clustering. XXX we= =20 > >> need a > >> * synchronous clustering mode implementation. > >> > >>It means for me that msync(MS_SYNC) flush every page on disk in single = IO > >>transaction. If we multiply 4K and 37 we get 150K. This number is siz= e=20 > >>of > >>the single transaction in my experience. > >> > >>+alc@, kib@ > >> > >>Am I right? Is there any plan to implement this? > >Current buffer clustering code can only do only async writes. In fact, I > >am not quite sure what would consitute the sync clustering, because the > >ability to delay the write is important to be able to cluster at all. > > > >Also, I am not sure that lack of clustering is the biggest problem. > >IMO, the fact that each write is sync is the first problem there. It > >would be quite a work to add the tracking of the issued writes to the > >vm_object_page_clean() and down the stack. Esp. due to custom page > >write vops in several fses. > > > >The only guarantee that POSIX requires from msync(MS_SYNC) is that > >the writes are finished when the syscall returned, and not that the > >writes are done synchronously. Below is the hack which should help if > >the msync()ed region contains the mapping of the whole file, since > >it is possible to fsync() the file after all writes are scheduled > >asynchronous then. It will causes unneeded metadata update, but I think > >it would be much faster still. > > > > > >diff --git a/sys/vm/vm_object.c b/sys/vm/vm_object.c > >index 250b769..a9de554 100644 > >--- a/sys/vm/vm_object.c > >+++ b/sys/vm/vm_object.c > >@@ -938,7 +938,7 @@ vm_object_sync(vm_object_t object, vm_ooffset_t=20 > >offset, vm_size_t size, > > vm_object_t backing_object; > > struct vnode *vp; > > struct mount *mp; > >- int flags; > >+ int flags, fsync_after; > > > > if (object =3D=3D NULL) > > return; > >@@ -971,11 +971,26 @@ vm_object_sync(vm_object_t object, vm_ooffset_t=20 > >offset, vm_size_t size, > > (void) vn_start_write(vp,&mp, V_WAIT); > > vfslocked =3D VFS_LOCK_GIANT(vp->v_mount); > > vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); > >- flags =3D (syncio || invalidate) ? OBJPC_SYNC : 0; > >- flags |=3D invalidate ? OBJPC_INVAL : 0; > >+ if (syncio&& !invalidate&& offset =3D=3D 0&& > >+ OFF_TO_IDX(size) =3D=3D object->size) { > >+ /* > >+ * If syncing the whole mapping of the file, > >+ * it is faster to schedule all the writes in > >+ * async mode, also allowing the clustering, > >+ * and then wait for i/o to complete. > >+ */ > >+ flags =3D 0; > >+ fsync_after =3D TRUE; > >+ } else { > >+ flags =3D (syncio || invalidate) ? OBJPC_SYNC : 0; > >+ flags |=3D invalidate ? (OBJPC_SYNC | OBJPC_INVAL) : 0; > >+ fsync_after =3D FALSE; > >+ } > > VM_OBJECT_LOCK(object); > > vm_object_page_clean(object, offset, offset + size, flags); > > VM_OBJECT_UNLOCK(object); > >+ if (fsync_after) > >+ (void) VOP_FSYNC(vp, MNT_WAIT, curthread); > > VOP_UNLOCK(vp, 0); > > VFS_UNLOCK_GIANT(vfslocked); > > vn_finished_write(mp); >=20 > Thanks, this patch works. Performance is the same as of using fsync(). >=20 > Actually, Linux uses fsync() inside of msync() if MS_SYNC is set. > http://git.kernel.org/?p=3Dlinux/kernel/git/torvalds/linux.git;a=3Dblob;f= =3Dmm/msync.c;h=3D632df4527c0122062d9332a0d483835274ed62f6;hb=3DHEAD >=20 I see, indeed Linux fully fsync the whole file if even single page of it appeared to be (non-shadowed) mmaped into the msync(MS_SYNC) region. I am not sure that we shall follow this behaviour. Alan, do you agree with the patch above ? --eA/EPO+dPjTdWiw1 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk7y/PMACgkQC3+MBN1Mb4hVPgCffSCnM6eR8Dns4WJBcDYDTpva fBcAoJtCGbz3vwkGGXz5en2Q4llLdcIr =oqRK -----END PGP SIGNATURE----- --eA/EPO+dPjTdWiw1-- From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 10:15:16 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 23DF31065672; Thu, 22 Dec 2011 10:15:16 +0000 (UTC) (envelope-from luigi@onelab2.iet.unipi.it) Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.59.238]) by mx1.freebsd.org (Postfix) with ESMTP id 831E68FC08; Thu, 22 Dec 2011 10:15:15 +0000 (UTC) Received: by onelab2.iet.unipi.it (Postfix, from userid 275) id AF6DF7300B; Thu, 22 Dec 2011 11:31:45 +0100 (CET) Date: Thu, 22 Dec 2011 11:31:45 +0100 From: Luigi Rizzo To: Steve Kargl Message-ID: <20111222103145.GA42457@onelab2.iet.unipi.it> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111222005250.GA23115@troutmask.apl.washington.edu> User-Agent: Mutt/1.4.2.3i Cc: Attilio Rao , Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 10:15:16 -0000 On Wed, Dec 21, 2011 at 04:52:50PM -0800, Steve Kargl wrote: > On Fri, Dec 16, 2011 at 12:14:24PM +0100, Attilio Rao wrote: > > 2011/12/15 Steve Kargl : > > > On Thu, Dec 15, 2011 at 05:25:51PM +0100, Attilio Rao wrote: > > >> > > >> I basically went through all the e-mail you just sent and identified 4 > > >> real report on which we could work on and summarizied in the attached > > >> Excel file. > > >> I'd like that George, Steve, Doug, Andrey and Mike possibly review the > > >> few datas there and add more, if they want, or make more important > > >> clarifications in particular about the Xorg presence (or rather not) > > >> in their workload. > > > > > > Your summary of my observations appears correct. > > > > > > I have grabbed an up-to-date /usr/src, built and > > > installed world, and built and installed a new > > > kernel on one of the nodes in my cluster. ??It > > > has > > > > > > > It seems a perfect environment, just please make sure you made a > > debug-free userland (setting MALLOC_PRODUCTION in jemalloc basically). > > > > The first thing is, can you try reproducing your case? As far as I got > > it, for you it was enough to run N + small_amount of CPU-bound threads > > to show performance penalty, so I'd ask you to start with using dnetc > > or just your preferred cpu-bound workload and verify you can reproduce > > the issue. > > As it happens, please monitor the threads bouncing and CPU utilization > > via 'top' (you don't need to be 100% precise, jut to get an idea, and > > keep an eye on things like excessive threads migration, thread binding > > obsessity, low throughput on CPU). > > One note: if your workloads need to do I/O please use a tempfs or > > memory storage to do so, in order to reduce I/O effects at all. > > Also, verify this doesn't happen with 4BSD scheduler, just in case. > > > > Finally, if the problem is still in place, please recompile your > > kernel by adding: > > options KTR > > options KTR_ENTRIES=262144 > > options KTR_COMPILE=(KTR_SCHED) > > options KTR_MASK=(KTR_SCHED) > > > > And reproduce the issue. > > When you are in the middle of the scheduling issue go with: > > # ktrdump -ctf > ktr-ule-problem-YOURNAME.out > > > > and send to the mailing list along with your dmesg and the > > informations on the CPU utilization you gathered by top(1). > > > > That should cover it all, but if you have further questions, please > > just go ahead. > > Attilio, > > I have placed several files at > > http://troutmask.apl.washington.edu/~kargl/freebsd > > dmesg.txt --> dmesg for ULE kernel > summary --> A summary that includes top(1) output of all runs. > sysctl.ule.txt --> sysctl -a for the ULE kernel > ktr-ule-problem-kargl.out.gz > > I performed a series of tests with both 4BSD and ULE kernels. > The 4BSD and ULE kernels are identical except of course for the > scheduler. Both witness and invariants are disabled, and malloc > has been compiled without debugging. > > Here's what I did. On the master node in my cluster, I ran an > OpenMPI code that sends N jobs off to the node with the kernel > of interest. There is communication between the master and > slaves to generate 16 independent chunks of data. Note, there > is no disk IO. So, for example, N=4 will start 4 essentially > identical numerically intensity jobs. At the start of a run, > the master node instructs each slave job to create a chunk of > data. After the data is created, the slave sends it back to the > master and the master sends instructions to create the next chunk > of data. This communication continues until the 16 chunks have > been assigned, computed, and returned to the master. > > Here is a rough measurement of the problem with ULE and numerical > intensity loads. This command is executed on the master > > time mpiexec -machinefile mf3 -np N sasmp sas.in > > Since time is executed on the master, only the 'real' time is of > interest (the summary file includes user and sys times). This > command is run at 5 times for each N value and up to 10 time for > some N values with the ULE kernel. The following table records > the average 'real' time and the number in (...) is the mean > absolute deviations. > > # N ULE 4BSD > # ------------------------------------- > # 4 223.27 (0.502) 221.76 (0.551) > # 5 404.35 (73.82) 270.68 (0.866) > # 6 627.56 (173.0) 247.23 (1.442) > # 7 475.53 (84.07) 285.78 (1.421) > # 8 429.45 (134.9) 223.64 (1.316) One explanation for taking 1.5-2x times is that with ULE the threads are not migrated properly, so you end up with idle cores and ready threads not running (the other possible explanation would be that there are migrations, but they are so frequent and expensive that they completely trash the caches. But this seems unlikely for this type of task). Also, perhaps one could build a simple test process that replicates this workload (so one can run it as part of regression tests): 1. define a CPU-intensive function f(n) which issues no system calls, optionally touching a lot of memory, where n determines the number of iterations. 2. by trial and error (or let the program find it), pick a value N1 so that the minimum execution time of f(N1) is in the 10..100ms range 3. now run the function f() again from an outer loop so that the total execution time is large (10..100s) again with no intervening system calls. 4. use an external shell script can rerun a process when it terminates, and then run multiple instances in parallel. Instead of the external script one could fork new instances before terminating, but i am a bit unclear how CPU inheritance works when a process forks. Going through the shell possibly breaks the chain. cheers luigi > These numbers to me demonstrate that ULE is not a good choice > for a HPC workload. > > If you need more information, feel free to ask. If you would > like access to the node, I can probably arrange that. But, > we can discuss that off-line. > > -- > Steve > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 10:22:49 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B8D05106566B; Thu, 22 Dec 2011 10:22:49 +0000 (UTC) (envelope-from ganael.laplanche@martymac.org) Received: from data.galacsys.net (webmail.galacsys.net [217.24.81.215]) by mx1.freebsd.org (Postfix) with ESMTP id 3A0A98FC15; Thu, 22 Dec 2011 10:22:49 +0000 (UTC) Received: from martymac.org (webmail.galacsys.net [217.24.81.215]) by data.galacsys.net (Postfix) with ESMTP id DDF9E16D166; Thu, 22 Dec 2011 11:22:47 +0100 (CET) From: "Ganael LAPLANCHE" To: Artem Belevich , Tijl Coosemans X-Openwebmail-Date: Thu, 22 Dec 2011 12:22:47 +0200 Message-Id: <20111222101830.M52727@martymac.org> In-Reply-To: References: <20111220080437.M63044@martymac.org> <4EF05F27.8030902@FreeBSD.org> <20111220134716.M62917@martymac.org> <20111220142740.M29405@martymac.org> <4EF0A3A7.80309@FreeBSD.org> X-Mailer: Open WebMail 2.01 20030425 X-OriginatingIP: 157.99.64.43 (ganael.laplanche@martymac.org) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Date: Thu, 22 Dec 2011 11:22:47 +0100 (CET) Cc: freebsd-stable@freebsd.org Subject: Re: Using mmap(2) with a hint address X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 10:22:49 -0000 Hi Artem, Tijl, On Tue, 20 Dec 2011 09:27:43 -0800, Artem Belevich wrote > Something like that. [...] > These days malloc() by default uses mmap, so if you don't force it to > use sbrk() you can probably lower MAXDSIZE and let kernel use most > of address space for hinted mmaps. > [...] On Tue, 20 Dec 2011 18:45:08 +0100, Tijl Coosemans wrote > I don't know about NetBSD but Linux maps from the stack > downwards when there's no hint and FreeBSD maps from the > program upwards. [...] > malloc(3) used to be implemented on top of brk(2) so the size was > increased on amd64 so you could malloc more memory. Nowadays malloc > can use mmap(2) so a large datasize isn't really needed anymore. I will use setrlimit(2) to lower datasize then. Thanks a lot for your time and explanations, Best regards, -- Ganael LAPLANCHE http://www.martymac.org | http://contribs.martymac.org FreeBSD: martymac , http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 11:02:23 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 59881106566C; Thu, 22 Dec 2011 11:02:23 +0000 (UTC) (envelope-from george+freebsd@m5p.com) Received: from mailhost.m5p.com (ip-3-2-0-2.r20.asbnva02.us.ce.gin.ntt.net [IPv6:2001:418:0:5000::16]) by mx1.freebsd.org (Postfix) with ESMTP id 0A9BE8FC1A; Thu, 22 Dec 2011 11:02:22 +0000 (UTC) Received: from wonderland.m5p.com (wonderland.m5p.com [IPv6:2001:418:3fd::19]) by mailhost.m5p.com (8.14.4/8.14.4) with ESMTP id pBMB2GoL014697; Thu, 22 Dec 2011 06:02:21 -0500 (EST) (envelope-from george+freebsd@m5p.com) Message-ID: <4EF30E38.1080200@m5p.com> Date: Thu, 22 Dec 2011 06:02:16 -0500 From: George Mitchell User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111127 Thunderbird/8.0 MIME-Version: 1.0 To: Adrian Chadd References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (mailhost.m5p.com [IPv6:2001:418:3fd::f7]); Thu, 22 Dec 2011 06:02:22 -0500 (EST) X-Scanned-By: MIMEDefang 2.72 on IPv6:2001:418:3fd::f7 Cc: Attilio Rao , Andrey Chernov , Doug Barton , freebsd-stable@freebsd.org, Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 11:02:23 -0000 On 12/22/11 04:07, Adrian Chadd wrote: > Are you able to go through the emails here and grab out Attilio's > example for generating KTR scheduler traces? > > > Adrian > [...] I've put up two such files: http://www.m5p.com/~george/ktr-ule-problem.out http://www.m5p.com/~george/ktr-ule-interact.out but I don't know how to analyze them myself. What do all of us do next? -- George Mitchell From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 14:50:54 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B5D641065692; Thu, 22 Dec 2011 14:50:54 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id 759538FC13; Thu, 22 Dec 2011 14:50:54 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBMEosks033328; Thu, 22 Dec 2011 06:50:54 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBMEosPL033327; Thu, 22 Dec 2011 06:50:54 -0800 (PST) (envelope-from sgk) Date: Thu, 22 Dec 2011 06:50:54 -0800 From: Steve Kargl To: Adrian Chadd Message-ID: <20111222145053.GA33289@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: Attilio Rao , Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 14:50:54 -0000 On Thu, Dec 22, 2011 at 01:07:58AM -0800, Adrian Chadd wrote: > Are you able to go through the emails here and grab out Attilio's > example for generating KTR scheduler traces? > Did your read this part of my email? > > > > Attilio, > > > > I have placed several files at > > > > http://troutmask.apl.washington.edu/~kargl/freebsd > > > > dmesg.txt --> dmesg for ULE kernel > > summary --> A summary that includes top(1) output of all runs. > > sysctl.ule.txt --> sysctl -a for the ULE kernel > > ktr-ule-problem-kargl.out.gz ktr-ule-problem-kargl.out is a 43 MB file. I don't the freebsd.org email server would allow that file through. -- Steve From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 15:02:06 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CB04106566C for ; Thu, 22 Dec 2011 15:02:06 +0000 (UTC) (envelope-from mailinglists@elfsechsundzwanzig.de) Received: from smtprelay02.ispgateway.de (smtprelay02.ispgateway.de [80.67.31.25]) by mx1.freebsd.org (Postfix) with ESMTP id 4070C8FC1A for ; Thu, 22 Dec 2011 15:02:05 +0000 (UTC) Received: from [78.34.255.133] (helo=Lux.localdomain) by smtprelay02.ispgateway.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1Rdk9k-0000IL-F8 for freebsd-stable@freebsd.org; Thu, 22 Dec 2011 16:02:04 +0100 Date: Thu, 22 Dec 2011 16:02:09 +0100 (CET) From: 1126 X-X-Sender: 1126@Lux.localdomain To: freebsd-stable@freebsd.org Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Df-Sender: bWFpbGluZ2xpc3RzQGVsZnNlY2hzdW5kendhbnppZy5kZQ== Subject: emacs-devel glib-warning X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 15:02:06 -0000 Hello! I considered switching from emacs23 to emacs24 over the christmas-holidays.. So I removed emacs23 and installed emacs-devel via ports. Emacs runs fine, in terminal, but it crashes my whole X-system when I try to start it as X-client... The error message tells me that there is a glib-problem: "GLib-WARNING **: In call to g_spawn_sync(), exit status of a child process was requested but SIGCHLD action was set to SIG_IGN and ECHILD was received by waitpid(), so exit status can't be returned. This is a bug in the program calling g_spawn_sync(); either don't request the exit status, or don't set the SIGCHLD action." I have emacs-devel installed, and glib-2.28.8_2. I am runnig xmonad as WM, but it happened on awesome as well.. Does anyone know what I can do to get emacs to work as X-client? ;) Thanks in advance! Greetings from rainy Cologne, 1126 From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 15:56:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B40231065672 for ; Thu, 22 Dec 2011 15:56:35 +0000 (UTC) (envelope-from boydjd@jbip.net) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 4B34F8FC12 for ; Thu, 22 Dec 2011 15:56:35 +0000 (UTC) Received: by eekc50 with SMTP id c50so10180632eek.13 for ; Thu, 22 Dec 2011 07:56:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jbip.net; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=rMuaLSep1ZDj20MIubKY/m3hr3LuU3KEW/r4eVnqcxY=; b=WdtIuKMbwcPt13NCqv8ipYOPQlrusYg1R7c/mpXn3eJ2rUOi2WoPnXHHDYvCxIAqfd wadPrG+8+S5yzhWFsrCn32IX7Ze3XZQLmUXT4brngW25vZuAfnKnF0Ui9WIsynWmz64T /0l3Vvf13gx0XsnSQF2VARRH7L78IOySoAFZw= Received: by 10.204.38.16 with SMTP id z16mr3428319bkd.66.1324569394289; Thu, 22 Dec 2011 07:56:34 -0800 (PST) MIME-Version: 1.0 Received: by 10.204.98.202 with HTTP; Thu, 22 Dec 2011 07:56:13 -0800 (PST) In-Reply-To: References: From: Joshua Boyd Date: Thu, 22 Dec 2011 10:56:13 -0500 Message-ID: To: Adam Vande More Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 15:56:35 -0000 On Wed, Dec 21, 2011 at 11:56 PM, Adam Vande More wrote: > VT-x(or the AMD equiv) is a CPU feature and is necessary to run 64-bit > guests. VT-d(or the AMD equiv)/IOMMU is the what is done in the chipset > however it isn't necessary to run 64-bit guests. Both of these features > are only found on CPU's supporting long mode. > Exactly. The E7300 lacks the VT-x bits. -- Joshua Boyd E-mail: boydjd@jbip.net http://www.jbip.net From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 16:02:01 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7E1211065670 for ; Thu, 22 Dec 2011 16:02:01 +0000 (UTC) (envelope-from prvs=0337f962c1=ob@gruft.de) Received: from main.mx.e-gitt.net (service.rules.org [IPv6:2001:1560:2342::2]) by mx1.freebsd.org (Postfix) with ESMTP id 163B18FC15 for ; Thu, 22 Dec 2011 16:02:01 +0000 (UTC) Received: from ob by main.mx.e-gitt.net with local (Exim 4.76 (FreeBSD)) (envelope-from ) id 1Rdl5h-000MOZ-M8 for freebsd-stable@freebsd.org; Thu, 22 Dec 2011 17:01:57 +0100 Date: Thu, 22 Dec 2011 17:01:57 +0100 From: Oliver Brandmueller To: freebsd-stable@freebsd.org Message-ID: <20111222160157.GB34540@e-Gitt.NET> Mail-Followup-To: freebsd-stable@freebsd.org References: <4EE1EAFE.3070408@m5p.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Sender: Oliver Brandmueller Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 16:02:01 -0000 On Thu, Dec 15, 2011 at 05:25:51PM +0100, Attilio Rao wrote: > If someone else thinks he has a specific problem that is not > characterized by one of the cases above please let me know and I will > put this in the chart. It seems I stumbled over another thing. Setup: 2 Servers providing devices by ggated, 1 Server using ggatec for those devices. ZFS over each a pair of disks provided by both ggated servers. I use rsync to fill up the 6 zpools/zfs from an existing storage (2 TB zpools, about 500 to 700 GiB user per pool). 2 rsyncs running in parallel to fill the partitions. Main server (ggate client with ZFS and rsync) has an Intel Xeon X3450 2.66 GHz quadcore processor (+HTT or whatever it's called nowadays, gives 8 "cpus" in FreeBSD). With ULE ZFS gets slower after some time and finally gets stuck after 1 to 3 days of continouus synchronisation (ggate works like a charm as far as I can tell), with 4BSD (online since 6 days) the rsync seems to run a lot faster and I didn't get ZFS to stall. There's nearly no local I/O (system is on a local SSD) and the load/CPU usage are not actually high. All is running a quite recent RELENG_9 If anyone's interested I can get more detail and carry out some tests. - Oliver -- | Oliver Brandmueller http://sysadm.in/ ob@sysadm.in | | Ich bin das Internet. Sowahr ich Gott helfe. | From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 16:31:09 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0B0101065691; Thu, 22 Dec 2011 16:31:09 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id D9A478FC0C; Thu, 22 Dec 2011 16:31:08 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBMGV772033805; Thu, 22 Dec 2011 08:31:07 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBMGV6Qm033804; Thu, 22 Dec 2011 08:31:06 -0800 (PST) (envelope-from sgk) Date: Thu, 22 Dec 2011 08:31:06 -0800 From: Steve Kargl To: Luigi Rizzo Message-ID: <20111222163106.GA33689@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111222103145.GA42457@onelab2.iet.unipi.it> User-Agent: Mutt/1.4.2.3i Cc: Attilio Rao , Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 16:31:09 -0000 On Thu, Dec 22, 2011 at 11:31:45AM +0100, Luigi Rizzo wrote: > On Wed, Dec 21, 2011 at 04:52:50PM -0800, Steve Kargl wrote: >> >> I have placed several files at >> >> http://troutmask.apl.washington.edu/~kargl/freebsd >> >> dmesg.txt --> dmesg for ULE kernel >> summary --> A summary that includes top(1) output of all runs. >> sysctl.ule.txt --> sysctl -a for the ULE kernel >> ktr-ule-problem-kargl.out.gz >> >> >> Since time is executed on the master, only the 'real' time is of >> interest (the summary file includes user and sys times). This >> command is run at 5 times for each N value and up to 10 time for >> some N values with the ULE kernel. The following table records >> the average 'real' time and the number in (...) is the mean >> absolute deviations. >> >> # N ULE 4BSD >> # ------------------------------------- >> # 4 223.27 (0.502) 221.76 (0.551) >> # 5 404.35 (73.82) 270.68 (0.866) >> # 6 627.56 (173.0) 247.23 (1.442) >> # 7 475.53 (84.07) 285.78 (1.421) >> # 8 429.45 (134.9) 223.64 (1.316) > > One explanation for taking 1.5-2x times is that with ULE the > threads are not migrated properly, so you end up with idle cores > and ready threads not running That's what I guessed back in 2008 when I first reported the behavior. http://freebsd.monkey.org/freebsd-current/200807/msg00278.html http://freebsd.monkey.org/freebsd-current/200807/msg00280.html The top(1) output at the above URL shows 10 completely independent instances of the same numerically intensive application running on a circa 2008 ULE kernel. Look at the PRI column. The high PRI jobs are not only pinned to a cpu, but these are running at 100% WCPU. The low PRI jobs seem to be pinned to a subset of the available cpus and simply ping-pong in and out of the same cpus. In this instance, there are 5 jobs competing for time on 3 cpus. > Also, perhaps one could build a simple test process that replicates > this workload (so one can run it as part of regression tests): > 1. define a CPU-intensive function f(n) which issues no > system calls, optionally touching > a lot of memory, where n determines the number of iterations. > 2. by trial and error (or let the program find it), > pick a value N1 so that the minimum execution time > of f(N1) is in the 10..100ms range > 3. now run the function f() again from an outer loop so > that the total execution time is large (10..100s) > again with no intervening system calls. > 4. use an external shell script can rerun a process > when it terminates, and then run multiple instances > in parallel. Instead of the external script one could > fork new instances before terminating, but i am a bit > unclear how CPU inheritance works when a process forks. > Going through the shell possibly breaks the chain. The tests at the above URL does essentially what you propose except in 2008 the kzk90 programs were doing some IO. -- Steve From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 17:32:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0FBCA1065670 for ; Thu, 22 Dec 2011 17:32:35 +0000 (UTC) (envelope-from jim@jimking.net) Received: from quartz.jimking.net (dsl-katy-207-70-162-186.consolidated.net [207.70.162.186]) by mx1.freebsd.org (Postfix) with ESMTP id AE7E88FC0A for ; Thu, 22 Dec 2011 17:32:34 +0000 (UTC) Received: from [192.168.1.121] (dsl-katy-207-70-162-235.consolidated.net [207.70.162.235]) (authenticated bits=0) by quartz.jimking.net (8.14.2/8.14.2) with ESMTP id pBMH4UPR028541 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 22 Dec 2011 11:04:30 -0600 (CST) (envelope-from jim@jimking.net) Message-ID: <4EF36322.8000804@jimking.net> Date: Thu, 22 Dec 2011 11:04:34 -0600 From: Jim King User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: FreeBSD 9 RC3 and VirtualBox X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 17:32:35 -0000 On 12/22/2011 9:56 AM, Joshua Boyd wrote: > On Wed, Dec 21, 2011 at 11:56 PM, Adam Vande Morewrote: > >> VT-x(or the AMD equiv) is a CPU feature and is necessary to run 64-bit >> guests. VT-d(or the AMD equiv)/IOMMU is the what is done in the chipset >> however it isn't necessary to run 64-bit guests. Both of these features >> are only found on CPU's supporting long mode. >> > Exactly. The E7300 lacks the VT-x bits. > > Actually there are three different part numbers for the E7300. Two of them have VT-x, one does not. From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 18:28:42 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D1B66106566C for ; Thu, 22 Dec 2011 18:28:42 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id A97B28FC08 for ; Thu, 22 Dec 2011 18:28:42 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) by cyrus.watson.org (Postfix) with ESMTPSA id 4CE5046B1A; Thu, 22 Dec 2011 13:28:42 -0500 (EST) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id D2031B91E; Thu, 22 Dec 2011 13:28:41 -0500 (EST) From: John Baldwin To: freebsd-stable@freebsd.org Date: Thu, 22 Dec 2011 11:44:18 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p8; KDE/4.5.5; amd64; ; ) References: In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201112221144.18966.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 22 Dec 2011 13:28:41 -0500 (EST) Cc: 1126 Subject: Re: emacs-devel glib-warning X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 18:28:42 -0000 On Thursday, December 22, 2011 10:02:09 am 1126 wrote: > Hello! > > I considered switching from emacs23 to emacs24 over the > christmas-holidays.. So I removed emacs23 and installed emacs-devel via > ports. Emacs runs fine, in terminal, but it crashes my whole X-system when > I try to start it as X-client... The error message tells me that there is > a glib-problem: "GLib-WARNING **: In call to g_spawn_sync(), exit status > of a child process was requested but SIGCHLD action was set to SIG_IGN and > ECHILD was received by waitpid(), so exit status can't be returned. This > is a bug in the program calling g_spawn_sync(); either don't request the > exit status, or don't set the SIGCHLD action." That is just a bug in emacs (or some library emacs is using). It happens even when emacs doesn't crash. I suspect it is unrelated to the problem you are having with your X server and that the crash is caused by something else emacs is doing. What do you mean in detail by "crashes my whole X-system". Does X actually core dump? Does X freeze or spin using 100% CPU? Does your window manager crash, etc.? One thing you can maybe try is building emacs without dbus or gconf and seeing if that works better. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 18:45:34 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D48E8106564A; Thu, 22 Dec 2011 18:45:34 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id 9035D8FC0A; Thu, 22 Dec 2011 18:45:34 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBMIjYkY036258; Thu, 22 Dec 2011 10:45:34 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBMIjVjp036255; Thu, 22 Dec 2011 10:45:31 -0800 (PST) (envelope-from sgk) Date: Thu, 22 Dec 2011 10:45:31 -0800 From: Steve Kargl To: Luigi Rizzo Message-ID: <20111222184531.GA36084@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20111222103145.GA42457@onelab2.iet.unipi.it> User-Agent: Mutt/1.4.2.3i Cc: Attilio Rao , Andrey Chernov , George Mitchell , Doug Barton , freebsd-stable@freebsd.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 18:45:34 -0000 On Thu, Dec 22, 2011 at 11:31:45AM +0100, Luigi Rizzo wrote: > On Wed, Dec 21, 2011 at 04:52:50PM -0800, Steve Kargl wrote: > > > > I have placed several files at > > > > http://troutmask.apl.washington.edu/~kargl/freebsd > > > > dmesg.txt --> dmesg for ULE kernel > > summary --> A summary that includes top(1) output of all runs. > > sysctl.ule.txt --> sysctl -a for the ULE kernel > > ktr-ule-problem-kargl.out.gz I've replaced the original version of the ktr file with a new version. The old version was corrupt due to my failure to set 'sysctl debug.ktr.mask=0' prior to the dump. > One explanation for taking 1.5-2x times is that with ULE the > threads are not migrated properly, so you end up with idle cores > and ready threads not running (the other possible explanation > would be that there are migrations, but they are so frequent and > expensive that they completely trash the caches. But this seems > unlikely for this type of task). I've used schedgraph to look at the ktrdump output. A jpg is available at http://troutmask.apl.washington.edu/~kargl/freebsd/ktr.jpg This shows the ping-pong effect where here 3 processes appear to be using 2 cpus while the remaining 2 processes are pinned to their cpus. -- Steve From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 19:01:23 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9B21F1065672 for ; Thu, 22 Dec 2011 19:01:23 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id E0F4B8FC1F for ; Thu, 22 Dec 2011 19:01:22 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id VAA20569; Thu, 22 Dec 2011 21:01:18 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1RdntF-0000B8-Mq; Thu, 22 Dec 2011 21:01:17 +0200 Message-ID: <4EF37E7B.4020505@FreeBSD.org> Date: Thu, 22 Dec 2011 21:01:15 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Steve Kargl References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> In-Reply-To: <20111222184531.GA36084@troutmask.apl.washington.edu> X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@FreeBSD.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 19:01:23 -0000 on 22/12/2011 20:45 Steve Kargl said the following: > I've used schedgraph to look at the ktrdump output. A jpg is > available at http://troutmask.apl.washington.edu/~kargl/freebsd/ktr.jpg > This shows the ping-pong effect where here 3 processes appear to be > using 2 cpus while the remaining 2 processes are pinned to their > cpus. I'd recommended enabling CPU-specific background colors via the menu in schedgraph for a better illustration of your findings. NB: I still don't understand the point of purposefully running N+1 CPU-bound processes. -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 19:47:41 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 520E7106564A; Thu, 22 Dec 2011 19:47:41 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id 298A78FC15; Thu, 22 Dec 2011 19:47:41 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBMJle9J037532; Thu, 22 Dec 2011 11:47:40 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBMJlefm037531; Thu, 22 Dec 2011 11:47:40 -0800 (PST) (envelope-from sgk) Date: Thu, 22 Dec 2011 11:47:40 -0800 From: Steve Kargl To: Andriy Gapon Message-ID: <20111222194740.GA36796@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF37E7B.4020505@FreeBSD.org> User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@FreeBSD.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 19:47:41 -0000 On Thu, Dec 22, 2011 at 09:01:15PM +0200, Andriy Gapon wrote: > on 22/12/2011 20:45 Steve Kargl said the following: > > I've used schedgraph to look at the ktrdump output. A jpg is > > available at http://troutmask.apl.washington.edu/~kargl/freebsd/ktr.jpg > > This shows the ping-pong effect where here 3 processes appear to be > > using 2 cpus while the remaining 2 processes are pinned to their > > cpus. > > I'd recommended enabling CPU-specific background colors via the menu in > schedgraph for a better illustration of your findings. > > NB: I still don't understand the point of purposefully running N+1 CPU-bound > processes. > The point is that this is a node in a HPC cluster with multiple users. Sure, I can start my job on this node with only N cpu-bound jobs. Now, when user John Doe wants to run his OpenMPI program should he login into the 12 nodes in the cluster to see if someone is already running N cpu-bound jobs on a given node? 4BSD gives my jobs and John Doe's jobs a fair share of the available cpus. ULE does not give a fair share and if you read the summary file I put up on the web, you see that it is fairly non-deterministic on when a OpenMPI run will finish (see the mean absolute deviations in the table of 'real' times that I posted). There is the additional observation in one of my 2008 emails (URLs have been posted) that if you have N+1 cpu-bound jobs with, say, job0 and job1 ping-ponging on cpu0 (due to ULE's cpu-affinity feature) and if I kill job2 running on cpu1, then neither job0 nor job1 will migrate to cpu1. So, one now has N cpu-bound jobs running on N-1 cpus. Finally, my initial post in this email thread was to tell O. Hartman to quit beating his head against a wall with ULE (in an HPC environment). Switch to 4BSD. This was based on my 2008 observations and I've now wasted 2 days gather additional information which only re-affirms my recommendation. -- Steve From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 20:25:42 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9D7061065670 for ; Thu, 22 Dec 2011 20:25:42 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 045C88FC13 for ; Thu, 22 Dec 2011 20:25:41 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id WAA21722; Thu, 22 Dec 2011 22:25:37 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1RdpCq-0000En-S3; Thu, 22 Dec 2011 22:25:36 +0200 Message-ID: <4EF39208.8050602@FreeBSD.org> Date: Thu, 22 Dec 2011 22:24:40 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Steve Kargl References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> In-Reply-To: <20111222194740.GA36796@troutmask.apl.washington.edu> X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@FreeBSD.org Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 20:25:42 -0000 on 22/12/2011 21:47 Steve Kargl said the following: > On Thu, Dec 22, 2011 at 09:01:15PM +0200, Andriy Gapon wrote: >> on 22/12/2011 20:45 Steve Kargl said the following: >>> I've used schedgraph to look at the ktrdump output. A jpg is >>> available at http://troutmask.apl.washington.edu/~kargl/freebsd/ktr.jpg >>> This shows the ping-pong effect where here 3 processes appear to be >>> using 2 cpus while the remaining 2 processes are pinned to their >>> cpus. >> >> I'd recommended enabling CPU-specific background colors via the menu in >> schedgraph for a better illustration of your findings. >> >> NB: I still don't understand the point of purposefully running N+1 CPU-bound >> processes. >> > > The point is that this is a node in a HPC cluster with > multiple users. Sure, I can start my job on this node > with only N cpu-bound jobs. Now, when user John Doe > wants to run his OpenMPI program should he login into > the 12 nodes in the cluster to see if someone is already > running N cpu-bound jobs on a given node? 4BSD > gives my jobs and John Doe's jobs a fair share of the > available cpus. ULE does not give a fair share and > if you read the summary file I put up on the web, > you see that it is fairly non-deterministic on when a > OpenMPI run will finish (see the mean absolute deviations > in the table of 'real' times that I posted). OK. I think I know why the uneven load occurs. I remember even trying to explain my observations. There are two things: 1. ULE doesn't have either a common across CPUs runqueue nor any other kind of mechanism for enforcing true global fairness of CPU resource sharing. 2. ULE's rebalancing code is biased and that leads to the situation where sub-groups of threads can share subsets of CPUs rather fairly, but there won't be a global fairness. I haven't really given any thought as to how to fix or workaround these issues. One dumb idea is to add an element of randomness to a choice between equally loaded CPUs (and their subsets) instead of having a permanent bias. > There is the additional observation in one of my 2008 > emails (URLs have been posted) that if you have N+1 > cpu-bound jobs with, say, job0 and job1 ping-ponging > on cpu0 (due to ULE's cpu-affinity feature) and if I > kill job2 running on cpu1, then neither job0 nor job1 > will migrate to cpu1. So, one now has N cpu-bound > jobs running on N-1 cpus. Have you checked recently that that is still the case? I would consider this a rather serious bug as opposed to a sub-optimal scheduling. > Finally, my initial post in this email thread was to > tell O. Hartman to quit beating his head against > a wall with ULE (in an HPC environment). Switch to > 4BSD. This was based on my 2008 observations and > I've now wasted 2 days gather additional information > which only re-affirms my recommendation. I think that any objective information has its value. So maybe the time is not really wasted. I think there is no argument that for your usage pattern 4BSD is better than ULE at the moment, because of the inherent design choices of both schedulers and their current implementations. But I think that ULE could be improved to produce more global fairness. P.S. But, but, this thread has seen so many different problem reports about ULE heaped together that it's very easy to get confused about what is caused by what and what is real and what is not. E.g. I don't think that there is a direct relation between this issue (N+1 CPU-bound tasks) and "my X is sluggish with ULE when I untar a large file". P.P.S. About the subject line. Let's recall why ULE has become a default. It has happened because of many observations from users and developers that "things" were faster/"snappier" with ULE than with 4BSD and a significant stream of requests to make it the default. So it's business as usual. The schedulers are different, so there those for whom one scheduler works better and those for whom the other works better and those for whom both work reasonably well and those for whom neither is satisfactory and those who don't really care/compare. There is a silent majority and the vocal minorities. There are specific bugs and quirks, advantages and disadvantages, usage patterns, hardware configurations and what not. When everybody starts to talk at the same time, it's a huge mess. But silently triaging and debugging one problem at a time also doesn't always work. There, I've said it. Let me now try to recall why I felt a need to say all of this :-) -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 23:04:51 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 619A7106564A for ; Thu, 22 Dec 2011 23:04:51 +0000 (UTC) (envelope-from crmartin@sgi.com) Received: from relay.sgi.com (relay3.sgi.com [192.48.152.1]) by mx1.freebsd.org (Postfix) with ESMTP id 4D08D8FC15 for ; Thu, 22 Dec 2011 23:04:50 +0000 (UTC) Received: from xmail.sgi.com (pv-excas1-dc21.corp.sgi.com [137.38.102.116]) by relay3.corp.sgi.com (Postfix) with ESMTP id 34EBFAC001 for ; Thu, 22 Dec 2011 15:04:50 -0800 (PST) Received: from [10.3.0.220] (10.3.0.220) by xmail.sgi.com (137.38.102.30) with Microsoft SMTP Server (TLS) id 14.1.339.1; Thu, 22 Dec 2011 17:04:49 -0600 Message-ID: <4EF3B790.5050509@sgi.com> Date: Thu, 22 Dec 2011 16:04:48 -0700 From: Charlie Martin Organization: Silicon Graphics, Inc. User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111101 SUSE/3.1.16 Lightning/1.0b2 Thunderbird/3.1.16 MIME-Version: 1.0 To: Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.3.0.220] Cc: Subject: Mystery panic, FreeBSD 7.2-PRE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 23:04:51 -0000 We've got another mystery panic in 7.2-PRE. Upgrading is not an option; however, if this is familiar to anyone, backporting a patch would be. The stack trace is: db_trace_self_wrapper() at 0xffffffff8019120a = db_trace_self_wrapper+0x2a^M panic() at 0xffffffff80308797 = panic+0x187^M devfs_populate_loop() at 0xffffffff802a45c8 = devfs_populate_loop+0x548^M devfs_populate() at 0xffffffff802a46ab = devfs_populate+0x3b^M devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts 24051, 7/9, rc 0^M KUP_APV() at 0xffffffff804d5995 = VOP_LOOKUP_APV+0x95^M lookup() at 0xffffffff80384a3e = lookup+0x4ce^M namei() at 0xffffffff80385768 = namei+0x2c8^M vn_open_cred() at 0xffffffff8039b283 = vn_open_cred+0x1b3^M kern_open() at 0xffffffff8039a4a0 = kern_open+0x110^M syscall() at 0xffffffff804b0e3c = syscall+0x1ec^M Xfast_syscall() at 0xffffffff80494ecb = Xfast_syscall+0xab^M --- syscall (5, FreeBSD ELF64, open), rip = 0x800e022fc, rsp = 0x7fffffbfa128, rbp = 0x801002240 ---^M KDB: enter: panic^M -- Charles R. (Charlie) Martin Senior Software Engineer SGI logo 1900 Pike Road Longmont, CO 80501 Phone: 303-532-0209 E-Mail: CRMartin@sgi.com Website: www.sgi.com From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 23:44:19 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 38C1A106564A; Thu, 22 Dec 2011 23:44:19 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id E011A8FC0C; Thu, 22 Dec 2011 23:44:18 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RdsJ5-000468-V0>; Fri, 23 Dec 2011 00:44:16 +0100 Received: from e178027232.adsl.alicedsl.de ([85.178.27.232] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RdsJ5-0003tb-Q0>; Fri, 23 Dec 2011 00:44:15 +0100 Message-ID: <4EF3C0CE.5040802@zedat.fu-berlin.de> Date: Fri, 23 Dec 2011 00:44:14 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:9.0) Gecko/20111222 Thunderbird/9.0 MIME-Version: 1.0 To: Alexander Leidinger References: In-Reply-To: X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig363DC61A08FC2B64410B086C" X-Originating-IP: 85.178.27.232 Cc: freebsd-performance@freebsd.org, freebsd-current@freebsd.org, freebsd-stable@freebsd.org, freebsd@jdc.parodius.com, igor@hybrid-lab.co.uk Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 23:44:19 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig363DC61A08FC2B64410B086C Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/21/11 19:41, Alexander Leidinger wrote: > Hi, >=20 > while the discussion continued here, some work started at some other pl= ace. Now... in case someone here is willing to help instead of talking, f= eel free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look= what can be improved. The page is far from perfect and needs some additi= onal people which are willing to improve it. >=20 > This is only part of the problem. A tuning page in the wiki - which cou= ld be referenced from the benchmark page - would be great too. Any volunt= eers? A first step would be to take he tuning-man-page and wikify it. Oth= er tuning sources are welcome too. >=20 > Every FreeBSD dev with a wiki account can hand out write access to the = wiki. The benchmark page gives contributor-access. If someone wants write= access create a FirstnameLastname account and ask here for contributor-a= ccess. >=20 > Don't worry if you think your english is not good enough, even some one= -word notes can help (and _my_ english got already corrected by other peo= ple on the benchmark page). >=20 > Bye, > Alexander. >=20 >=20 >=20 >=20 Nice to see movement ;-) But there seems something unclear: man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in /etc/make.conf. The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. What's right and what's wrong now? Oliver --------------enig363DC61A08FC2B64410B086C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO88DOAAoJEOgBcD7A/5N8fsMIAJqxov2X2KfdyjzSXd89kYdD w/JFgI4xZCVaStAHWTyHm7UJh+cQvaZBqGtKiBooTdiLcbhwOck7YgQ9WL8piCS/ CBvjHZC7xPUSIywIvVA7uGf9i3Lbxq/TuoO9+Qk9AOfKtZswn6hATMtlNMyw0OC6 bJBp0rGa7MHsFQ020z5tomRqfU2ANdu3GrrLpge9rTOUCZ+ieq7GGrWEwlTFiDAM bd7NCiWyjgBtsjLBYsS0mjhE6aNW5i1fyT74AzNEyNn5BTWSTg0QPyNS0VXUTdec lNsCQxFbmmX17tPjCBiCACKn99sYQ8PTDq49F5ksj57Ku9LzIQZLaXa7kRpVB9I= =ikbF -----END PGP SIGNATURE----- --------------enig363DC61A08FC2B64410B086C-- From owner-freebsd-stable@FreeBSD.ORG Thu Dec 22 23:58:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 13F1C1065672 for ; Thu, 22 Dec 2011 23:58:50 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta09.westchester.pa.mail.comcast.net (qmta09.westchester.pa.mail.comcast.net [76.96.62.96]) by mx1.freebsd.org (Postfix) with ESMTP id C6DC98FC16 for ; Thu, 22 Dec 2011 23:58:49 +0000 (UTC) Received: from omta21.westchester.pa.mail.comcast.net ([76.96.62.72]) by qmta09.westchester.pa.mail.comcast.net with comcast id CNVM1i0061ZXKqc59PyqRy; Thu, 22 Dec 2011 23:58:50 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta21.westchester.pa.mail.comcast.net with comcast id CPyo1i0151t3BNj3hPyocH; Thu, 22 Dec 2011 23:58:50 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id E5F55102C19; Thu, 22 Dec 2011 15:58:46 -0800 (PST) Date: Thu, 22 Dec 2011 15:58:46 -0800 From: Jeremy Chadwick To: "O. Hartmann" Message-ID: <20111222235846.GA6071@icarus.home.lan> References: <4EF3C0CE.5040802@zedat.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF3C0CE.5040802@zedat.fu-berlin.de> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Alexander Leidinger , freebsd-performance@freebsd.org, freebsd-current@freebsd.org, freebsd-stable@freebsd.org, igor@hybrid-lab.co.uk Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 23:58:50 -0000 On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: > On 12/21/11 19:41, Alexander Leidinger wrote: > > Hi, > > > > while the discussion continued here, some work started at some other place. Now... in case someone here is willing to help instead of talking, feel free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look what can be improved. The page is far from perfect and needs some additional people which are willing to improve it. > > > > This is only part of the problem. A tuning page in the wiki - which could be referenced from the benchmark page - would be great too. Any volunteers? A first step would be to take he tuning-man-page and wikify it. Other tuning sources are welcome too. > > > > Every FreeBSD dev with a wiki account can hand out write access to the wiki. The benchmark page gives contributor-access. If someone wants write access create a FirstnameLastname account and ask here for contributor-access. > > > > Don't worry if you think your english is not good enough, even some one-word notes can help (and _my_ english got already corrected by other people on the benchmark page). > > > > Bye, > > Alexander. > > > > > > > > > > Nice to see movement ;-) > > But there seems something unclear: > > man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in > /etc/make.conf. > The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. > > What's right and what's wrong now? I can say with certainty that this value belongs in /etc/make.conf (on RELENG_8 and earlier at least). src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, so, this is definitely a make.conf variable. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 00:07:07 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 39A41106566C for ; Fri, 23 Dec 2011 00:07:07 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta15.emeryville.ca.mail.comcast.net (qmta15.emeryville.ca.mail.comcast.net [76.96.27.228]) by mx1.freebsd.org (Postfix) with ESMTP id 21F398FC1B for ; Fri, 23 Dec 2011 00:07:06 +0000 (UTC) Received: from omta06.emeryville.ca.mail.comcast.net ([76.96.30.51]) by qmta15.emeryville.ca.mail.comcast.net with comcast id CPse1i00416AWCUAFQ70ot; Fri, 23 Dec 2011 00:07:00 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta06.emeryville.ca.mail.comcast.net with comcast id CQ6a1i00q1t3BNj8SQ6bJV; Fri, 23 Dec 2011 00:06:35 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id C330C102C19; Thu, 22 Dec 2011 16:07:05 -0800 (PST) Date: Thu, 22 Dec 2011 16:07:05 -0800 From: Jeremy Chadwick To: Charlie Martin Message-ID: <20111223000705.GA6242@icarus.home.lan> References: <4EF3B790.5050509@sgi.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF3B790.5050509@sgi.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@FreeBSD.org Subject: Re: Mystery panic, FreeBSD 7.2-PRE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 00:07:07 -0000 On Thu, Dec 22, 2011 at 04:04:48PM -0700, Charlie Martin wrote: > We've got another mystery panic in 7.2-PRE. Upgrading is not an > option; however, if this is familiar to anyone, backporting a patch > would be. > > The stack trace is: > > db_trace_self_wrapper() at 0xffffffff8019120a = db_trace_self_wrapper+0x2a^M > panic() at 0xffffffff80308797 = panic+0x187^M > devfs_populate_loop() at 0xffffffff802a45c8 = devfs_populate_loop+0x548^M > devfs_populate() at 0xffffffff802a46ab = devfs_populate+0x3b^M > devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M > VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts > 24051, 7/9, > rc 0^M > KUP_APV() at 0xffffffff804d5995 = VOP_LOOKUP_APV+0x95^M > lookup() at 0xffffffff80384a3e = lookup+0x4ce^M > namei() at 0xffffffff80385768 = namei+0x2c8^M > vn_open_cred() at 0xffffffff8039b283 = vn_open_cred+0x1b3^M > kern_open() at 0xffffffff8039a4a0 = kern_open+0x110^M > syscall() at 0xffffffff804b0e3c = syscall+0x1ec^M > Xfast_syscall() at 0xffffffff80494ecb = Xfast_syscall+0xab^M > --- syscall (5, FreeBSD ELF64, open), rip = 0x800e022fc, rsp = > 0x7fffffbfa128, > rbp = 0x801002240 ---^M > KDB: enter: panic^M devfs(5) has been massively worked on in RELENG_8 and newer. You should go through the below commits and see if you can find one that references a PR with a similar backtrace, or mentions things like devfs_lookup(). http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/fs/devfs/ Also, be aware that the above stack trace is interspersed. Ultimately you get to clean up the output yourself. This is a long-standing problem with FreeBSD which can be helped but only slightly/barely by using "options PRINTF_BUFR_SIZE=256" in your kernel configuration (the default configs have a value of 128. Do not increase the value too high, there are concerns about it causing major issues; I can dig up the post that says that, but I'd rather not). It *will not* solve the problem of interspersed output entirely. There still is no fix for this problem... :-( What I'm referring to: > devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M > VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts > 24051, 7/9, > rc 0^M > lookup() at 0xffffffff80384a3e = lookup+0x4ce^M This should actually read (I think): > devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M > VOP_LOOKUP_APV() at 0xffffffff804d5995 = VOP_LOOKUP_APV+0x95^M > [24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts 24051, 7/9, rc 0^M -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 00:23:30 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 938AB1065670; Fri, 23 Dec 2011 00:23:30 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 14F198FC13; Fri, 23 Dec 2011 00:23:29 +0000 (UTC) Received: by vbbfr13 with SMTP id fr13so12447705vbb.13 for ; Thu, 22 Dec 2011 16:23:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=FSPrnK6PwbTWy4RygGGU8j1rUAQHXErAehW+F9jYDyI=; b=xKe50iaEs9AVuRiitVAF2U00PvSZFokTxy/dRpPQfD5aAwyan86nsloIih8J2nghIi o6abdh3ii8u0yR95DMNL8G/Qmkj4huF+v0zn5Dsnjm2YpM72tlU+1Qi3EG8q9cbh7SjP DxCobFjR0n55k7FacpnBn1PaJow0gBlxOW4ug= MIME-Version: 1.0 Received: by 10.52.29.16 with SMTP id f16mr6849502vdh.45.1324599809245; Thu, 22 Dec 2011 16:23:29 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.36.5 with HTTP; Thu, 22 Dec 2011 16:23:29 -0800 (PST) In-Reply-To: <20111222194740.GA36796@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> Date: Thu, 22 Dec 2011 16:23:29 -0800 X-Google-Sender-Auth: K5z1Y1MzzrN5mev4pPsJ7xV8A14 Message-ID: From: Adrian Chadd To: Steve Kargl Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 00:23:30 -0000 On 22 December 2011 11:47, Steve Kargl w= rote: [snip] Thankyou for posting some actual measurements! > There is the additional observation in one of my 2008 > emails (URLs have been posted) that if you have N+1 > cpu-bound jobs with, say, job0 and job1 ping-ponging > on cpu0 (due to ULE's cpu-affinity feature) and if I > kill job2 running on cpu1, then neither job0 nor job1 > will migrate to cpu1. =A0So, one now has N cpu-bound > jobs running on N-1 cpus. .. and this sounds like a pretty serious regression. Have you ever filed a PR for it? > Finally, my initial post in this email thread was to > tell O. Hartman to quit beating his head against > a wall with ULE (in an HPC environment). =A0Switch to > 4BSD. =A0This was based on my 2008 observations and > I've now wasted 2 days gather additional information > which only re-affirms my recommendation. I personally don't think this is time wasted. You've done something that noone else has actually done - provided actual results from real-life testing, rather than a hundred posts of "I remember seeing X, so I don't use ULE." If you can definitely and consistently reproduce that N-1 cpu bound job bug, you're now in a great position to easily test and re-report KTR/schedtrace results to see what impact they have. Please don't underestimate exactly how valuable this is. How often are those two jobs migrating between CPUs? How am I supposed to read "CPU load" ? Why isn't it just sitting at 100% the whole time? Would you mind repeating this with 4BSD (the N+1 jobs) so we can see how the jobs are scheduled/interleaved? Something tells me we'll see it the jobs being scheduled evenly Adrian From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 00:35:53 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id F35B21065673; Fri, 23 Dec 2011 00:35:52 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: from 172-17-198-245.globalsuite.net (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 385D4157E19; Fri, 23 Dec 2011 00:35:08 +0000 (UTC) Message-ID: <4EF3CCBB.6060503@FreeBSD.org> Date: Thu, 22 Dec 2011 16:35:07 -0800 From: Doug Barton Organization: http://SupersetSolutions.com/ User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111110 Thunderbird/8.0 MIME-Version: 1.0 To: Adrian Chadd References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> In-Reply-To: X-Enigmail-Version: undefined OpenPGP: id=1A1ABC84 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, Andriy Gapon , Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 00:35:53 -0000 On 12/22/2011 16:23, Adrian Chadd wrote: > You've done something > that noone else has actually done - provided actual results from > real-life testing, rather than a hundred posts of "I remember seeing > X, so I don't use ULE." Not to take away from Steve's excellent work on this, but I actually spent weeks following detailed instructions from various people using ktr, dtrace, etc. and was never able to produce any data that helped point anyone to something that could be fixed. I'm pretty sure that others have tried as well. That said, I'm glad that Steve was able to produce useful results, and hopefully it will lead to improvements. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 00:59:33 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1D192106568A; Fri, 23 Dec 2011 00:59:33 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id CA8FB8FC08; Fri, 23 Dec 2011 00:59:32 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBN0xWe6047892; Thu, 22 Dec 2011 16:59:32 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBN0xWmM047891; Thu, 22 Dec 2011 16:59:32 -0800 (PST) (envelope-from sgk) Date: Thu, 22 Dec 2011 16:59:32 -0800 From: Steve Kargl To: Adrian Chadd Message-ID: <20111223005932.GA47439@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 00:59:33 -0000 On Thu, Dec 22, 2011 at 04:23:29PM -0800, Adrian Chadd wrote: > On 22 December 2011 11:47, Steve Kargl wrote: > > > There is the additional observation in one of my 2008 > > emails (URLs have been posted) that if you have N+1 > > cpu-bound jobs with, say, job0 and job1 ping-ponging > > on cpu0 (due to ULE's cpu-affinity feature) and if I > > kill job2 running on cpu1, then neither job0 nor job1 > > will migrate to cpu1. ?So, one now has N cpu-bound > > jobs running on N-1 cpus. > > .. and this sounds like a pretty serious regression. Have you ever > filed a PR for it? No. I was interacting directly with jeffr in 2008. I got as far as setting up root access on a node for jeffr. Unfortunately, both jeffr and I got busy with real life, and 4BSD allowed me to get my work done. > > Finally, my initial post in this email thread was to > > tell O. Hartman to quit beating his head against > > a wall with ULE (in an HPC environment). ?Switch to > > 4BSD. ?This was based on my 2008 observations and > > I've now wasted 2 days gather additional information > > which only re-affirms my recommendation. > > I personally don't think this is time wasted. You've done something > that noone else has actually done - provided actual results from > real-life testing, rather than a hundred posts of "I remember seeing > X, so I don't use ULE." > > If you can definitely and consistently reproduce that N-1 cpu bound > job bug, you're now in a great position to easily test and re-report > KTR/schedtrace results to see what impact they have. Please don't > underestimate exactly how valuable this is. I'll try this tomorrow. I first need to modify the code I used in the 2008 test to disable IO, so that it is nearly completely cpu-bound. > How often are those two jobs migrating between CPUs? How am I supposed > to read "CPU load" ? Why isn't it just sitting at 100% the whole time? This is my 1st foray into ktr and schedgraph, so I may not have done something incorrectly. In particular, it seems that schedgraph takes the cpu clock as a command line argument, so there is probably some scaling that I'm missing. > Would you mind repeating this with 4BSD (the N+1 jobs) so we can see > how the jobs are scheduled/interleaved? Something tells me we'll see > it the jobs being scheduled evenly Sure, I'll do this tomorrow as well. -- Steve From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 02:56:32 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F03DC106564A; Fri, 23 Dec 2011 02:56:31 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 9572C8FC0A; Fri, 23 Dec 2011 02:56:31 +0000 (UTC) Received: by iadj38 with SMTP id j38so16048658iad.13 for ; Thu, 22 Dec 2011 18:56:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; bh=C7U0E5PPsXEkzu6WcR6qQiAumZ0/fligcBBPx+q5vbI=; b=Y9k2MSZvPbLQDnA/bCDeEwk1xJG5A4DfHyTUGCHHLgYw1KT1hjcVBQinR8OBDvF1s2 QUK7mVuhaELk+i1bB5xR4/Fuo/oo0cVZ7GalqLM9pgb9c8O7nL8JJBOIeufhjqY2Pg5d Lc332WMvE8mayCPh3fwMSUx34dj3XjoYxZ9qU= Received: by 10.50.170.35 with SMTP id aj3mr11595295igc.2.1324608991063; Thu, 22 Dec 2011 18:56:31 -0800 (PST) Received: from [10.75.41.133] (mobile-166-205-136-165.mycingular.net. [166.205.136.165]) by mx.google.com with ESMTPS id gf6sm38973155igb.1.2011.12.22.18.56.25 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 22 Dec 2011 18:56:30 -0800 (PST) References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> In-Reply-To: <20111222235846.GA6071@icarus.home.lan> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: <9706CBFC-9A69-4365-8883-FF45BDFDC108@gmail.com> X-Mailer: iPhone Mail (9A405) From: Garrett Cooper Date: Thu, 22 Dec 2011 18:56:17 -0800 To: Jeremy Chadwick Cc: "freebsd-stable@freebsd.org" , "freebsd-current@freebsd.org" , "igor@hybrid-lab.co.uk" , Alexander Leidinger , "freebsd-performance@freebsd.org" , "O. Hartmann" Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 02:56:32 -0000 On Dec 22, 2011, at 3:58 PM, Jeremy Chadwick wrot= e: > On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: >> On 12/21/11 19:41, Alexander Leidinger wrote: >>> Hi, >>>=20 >>> while the discussion continued here, some work started at some other pla= ce. Now... in case someone here is willing to help instead of talking, feel f= ree to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look what ca= n be improved. The page is far from perfect and needs some additional people= which are willing to improve it. >>>=20 >>> This is only part of the problem. A tuning page in the wiki - which coul= d be referenced from the benchmark page - would be great too. Any volunteers= ? A first step would be to take he tuning-man-page and wikify it. Other tuni= ng sources are welcome too. >>>=20 >>> Every FreeBSD dev with a wiki account can hand out write access to the w= iki. The benchmark page gives contributor-access. If someone wants write acc= ess create a FirstnameLastname account and ask here for contributor-access. >>>=20 >>> Don't worry if you think your english is not good enough, even some one-= word notes can help (and _my_ english got already corrected by other people o= n the benchmark page). >>>=20 >>> Bye, >>> Alexander. >>>=20 >>>=20 >>>=20 >>>=20 >>=20 >> Nice to see movement ;-) >>=20 >> But there seems something unclear: >>=20 >> man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in >> /etc/make.conf. >> The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. >>=20 >> What's right and what's wrong now? >=20 > I can say with certainty that this value belongs in /etc/make.conf > (on RELENG_8 and earlier at least). >=20 > src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, > so, this is definitely a make.conf variable. Take the advice in tuning(7) with a grain of salt because a number of sugges= tions are really outdated. I know because I filed a PR last night after I sa= w how out of synch some of the defaults it claimed were with reality on 9.x+= . And I know other suggestions in the manpage are dated as well ;/. Thanks, -Garrett= From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 04:45:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 46186106564A for ; Fri, 23 Dec 2011 04:45:35 +0000 (UTC) (envelope-from tamgya@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 073148FC12 for ; Fri, 23 Dec 2011 04:45:34 +0000 (UTC) Received: by iadj38 with SMTP id j38so16234972iad.13 for ; Thu, 22 Dec 2011 20:45:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=from:to:cc:subject:in-reply-to:organization:references:user-agent :x-envelope-to:mail-followup-to:date:message-id:mime-version :content-type; bh=rs0GnL9DLpr0ykWX/bzamO78DKbLD2+hYiil8rZ1cLI=; b=blMAXQXDl5FZt40IS7EyLCD6IGZDSGTS/2unhbLNIVO499+KjQowqv1K5UAJynFJVv w6dCOJ6duOygvXHL2HEkG280G8FZnsgyWOqy7y4X6bi5XEfOfivASn/hvyVe1hF7IuJh Wgs+zwJe1BiFD4cB5r/do0Dn7D3RH7+5Ur02U= Received: by 10.42.19.195 with SMTP id d3mr13179016icb.21.1324614222532; Thu, 22 Dec 2011 20:23:42 -0800 (PST) Received: from localhost ([58.129.165.156]) by mx.google.com with ESMTPS id j3sm36547361ibj.1.2011.12.22.20.23.38 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 22 Dec 2011 20:23:41 -0800 (PST) From: tamgya@gmail.com (Denise H. G.) To: 1126 In-Reply-To: (1126's message of "Thu, 22 Dec 2011 16:02:09 +0100 (CET)") Organization: Pluto The Planet References: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.3 (berkeley-unix) X-Envelope-To: mailinglists@elfsechsundzwanzig.de Mail-Followup-To: 1126 , freebsd-stable@freebsd.org Date: Fri, 23 Dec 2011 12:23:31 +0800 Message-ID: <864nwrj4qk.fsf@mars.xbsd.name> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-stable@freebsd.org Subject: Re: emacs-devel glib-warning X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 04:45:35 -0000 On 2011/12/22 at 23:02, 1126 wrote: > > Hello! > I considered switching from emacs23 to emacs24 over the > christmas-holidays.. So I removed emacs23 and installed emacs-devel > via ports. Emacs runs fine, in terminal, but it crashes my whole > X-system when I try to start it as X-client... The error message tells > me that there is a glib-problem: "GLib-WARNING **: In call to > g_spawn_sync(), exit status of a child process was requested but > SIGCHLD action was set to SIG_IGN and ECHILD was received by > waitpid(), so exit status can't be returned. This is a bug in the > program calling g_spawn_sync(); either don't request the exit status, > or don't set the SIGCHLD action." I am currently using emacs-devel, however, I have been using glib-2.30.x from marcus's experimental ports for a while. It seems everything is ok. Either you can tweak some configure args availabe to emacs-devel, and see how it is going, or you might pull the glib-2.30.x port from Marcus's site and give it a try. Good luck! > > I have emacs-devel installed, and glib-2.28.8_2. > > I am runnig xmonad as WM, but it happened on awesome as well.. > > Does anyone know what I can do to get emacs to work as X-client? ;) > > Thanks in advance! > Greetings from rainy Cologne, > 1126 > > ................ -- The inside contact that you have developed at great expense is the first person to be let go in any reorganization. From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 07:56:03 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 297681065676 for ; Fri, 23 Dec 2011 07:56:03 +0000 (UTC) (envelope-from alc@rice.edu) Received: from mh2.mail.rice.edu (mh2.mail.rice.edu [128.42.201.21]) by mx1.freebsd.org (Postfix) with ESMTP id DC69A8FC13 for ; Fri, 23 Dec 2011 07:56:02 +0000 (UTC) Received: from mh2.mail.rice.edu (localhost.localdomain [127.0.0.1]) by mh2.mail.rice.edu (Postfix) with ESMTP id BD12D291F71; Fri, 23 Dec 2011 01:39:23 -0600 (CST) Received: from mh2.mail.rice.edu (localhost.localdomain [127.0.0.1]) by mh2.mail.rice.edu (Postfix) with ESMTP id AB5EA297607; Fri, 23 Dec 2011 01:39:23 -0600 (CST) X-Virus-Scanned: by amavis-2.6.4 at mh2.mail.rice.edu, auth channel Received: from mh2.mail.rice.edu ([127.0.0.1]) by mh2.mail.rice.edu (mh2.mail.rice.edu [127.0.0.1]) (amavis, port 10026) with ESMTP id oWn0tgCNt8eJ; Fri, 23 Dec 2011 01:39:23 -0600 (CST) Received: from adsl-216-63-78-18.dsl.hstntx.swbell.net (adsl-216-63-78-18.dsl.hstntx.swbell.net [216.63.78.18]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) (Authenticated sender: alc) by mh2.mail.rice.edu (Postfix) with ESMTPSA id DE564291F71; Fri, 23 Dec 2011 01:39:22 -0600 (CST) Message-ID: <4EF4302A.1080708@rice.edu> Date: Fri, 23 Dec 2011 01:39:22 -0600 From: Alan Cox User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:8.0) Gecko/20111113 Thunderbird/8.0 MIME-Version: 1.0 To: Kostik Belousov References: <4EE7BF77.5000504@zonov.org> <20111213221501.GA85563@icarus.home.lan> <4EE8E6E3.7050202@zonov.org> <20111214182252.GA5176@icarus.home.lan> <4EE8FD3E.8030902@zonov.org> <20111214204201.GA7372@icarus.home.lan> <20111215130111.GN50300@deviant.kiev.zoral.com.ua> <4EF21146.9010107@zonov.org> <20111222094836.GD50300@deviant.kiev.zoral.com.ua> In-Reply-To: <20111222094836.GD50300@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: alc@freebsd.org, Andrey Zonov , freebsd-stable@freebsd.org, Jeremy Chadwick Subject: Re: directory listing hangs in "ufs" state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 07:56:03 -0000 On 12/22/2011 03:48, Kostik Belousov wrote: > On Wed, Dec 21, 2011 at 09:03:02PM +0400, Andrey Zonov wrote: >> On 15.12.2011 17:01, Kostik Belousov wrote: >>> On Thu, Dec 15, 2011 at 03:51:02PM +0400, Andrey Zonov wrote: >>>> On Thu, Dec 15, 2011 at 12:42 AM, Jeremy Chadwick >>>> wrote: >>>> >>>>> On Wed, Dec 14, 2011 at 11:47:10PM +0400, Andrey Zonov wrote: >>>>>> On 14.12.2011 22:22, Jeremy Chadwick wrote: >>>>>>> On Wed, Dec 14, 2011 at 10:11:47PM +0400, Andrey Zonov wrote: >>>>>>>> Hi Jeremy, >>>>>>>> >>>>>>>> This is not hardware problem, I've already checked that. I also ran >>>>>>>> fsck today and got no errors. >>>>>>>> >>>>>>>> After some more exploration of how mongodb works, I found that then >>>>>>>> listing hangs, one of mongodb thread is in "biowr" state for a long >>>>>>>> time. It periodically calls msync(MS_SYNC) accordingly to ktrace >>>>>>>> out. >>>>>>>> >>>>>>>> If I'll remove msync() calls from mongodb, how often data will be >>>>>>>> sync by OS? >>>>>>>> >>>>>>>> -- >>>>>>>> Andrey Zonov >>>>>>>> >>>>>>>> On 14.12.2011 2:15, Jeremy Chadwick wrote: >>>>>>>>> On Wed, Dec 14, 2011 at 01:11:19AM +0400, Andrey Zonov wrote: >>>>>>>>>> Have you any ideas what is going on? or how to catch the problem? >>>>>>>>> Assuming this isn't a file on the root filesystem, try booting the >>>>>>>>> machine in single-user mode and using "fsck -f" on the filesystem in >>>>>>>>> question. >>>>>>>>> >>>>>>>>> Can you verify there's no problems with the disk this file lives on >>>>>>>>> as >>>>>>>>> well (smartctl -a /dev/disk)? I'm doubting this is the problem, but >>>>>>>>> thought I'd mention it. >>>>>>> I have no real answer, I'm sorry. msync(2) indicates it's effectively >>>>>>> deprecated (see BUGS). It looks like this is effectively a >>>>>>> mmap-version >>>>>>> of fsync(2). >>>>>> I replaced msync(2) with fsync(2). Unfortunately, from man pages it >>>>>> is not obvious that I can do this. Anyway, thanks. >>>>> Sorry, that wasn't what I was implying. Let me try to explain >>>>> differently. >>>>> >>>>> msync(2) looks, to me, like an mmap-specific version of fsync(2). Based >>>>> on the man page, it seems that the with msync() you can effectively >>>>> guaranteed flushing of certain pages within an mmap()'d region to disk. >>>>> fsync() would flush **all** buffers/internal pages to be flushed to >>>>> disk. >>>>> >>>>> One would need to look at the code to mongodb to find out what it's >>>>> actually doing with msync(). That is to say, if it's doing something >>>>> like this (I probably have the semantics wrong -- I've never spent much >>>>> time with mmap()): >>>>> >>>>> fd = open("/some/file", O_RDWR); >>>>> ptr = mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_SHARED, fd, 0); >>>>> ret = msync(ptr, 65536, MS_SYNC); >>>>> /* or alternatively, this: >>>>> ret = msync(ptr, NULL, MS_SYNC); >>>>> */ >>>>> >>>>> Then this, to me, would be mostly the equivalent to: >>>>> >>>>> fd = fopen("/some/file", "r+"); >>>>> ret = fsync(fd); >>>>> >>>>> Otherwise, if it's calling msync() only on an address/location within >>>>> the region ptr points to, then that may be more efficient (less pages to >>>>> flush). >>>>> >>>> They call msync() for the whole file. So, there will not be any >>>> difference. >>>> >>>> >>>>> The mmap() arguments -- specifically flags (see man page) -- also play >>>>> a role here. The one that catches my attention is MAP_NOSYNC. So you >>>>> may need to look at the mongodb code to figure out what it's mmap() >>>>> call is. >>>>> >>>>> One might wonder why they don't just use open() with the O_SYNC. I >>>>> imagine that has to do with, again, performance; possibly the don't want >>>>> all I/O synchronous, and would rather flush certain pages in the mmap'd >>>>> region to disk as needed. I see the legitimacy in that approach (vs. >>>>> just using O_SYNC). >>>>> >>>>> There's really no easy way for me to tell you which is more efficient, >>>>> better, blah blah without spending a lot of time with a benchmarking >>>>> program that tests all of this, *plus* an entire system (world) built >>>>> with profiling. >>>>> >>>> I ran for two hours mongodb with fsync() and got the following: >>>> STARTED INBLK OUBLK MAJFLT MINFLT >>>> Thu Dec 15 10:34:52 2011 3 192744 314 3080182 >>>> >>>> This is output of `ps -o lstart,inblock,oublock,majflt,minflt -U mongodb'. >>>> >>>> Then I ran it with default msync(): >>>> STARTED INBLK OUBLK MAJFLT MINFLT >>>> Thu Dec 15 12:34:53 2011 0 7241555 79 5401945 >>>> >>>> There are also two graphics of disk business [1] [2]. >>>> >>>> The difference is significant, in 37 times! That what I expected to get. >>>> >>>> In commentaries for vm_object_page_clean() I found this: >>>> >>>> * When stuffing pages asynchronously, allow clustering. XXX we >>>> need a >>>> * synchronous clustering mode implementation. >>>> >>>> It means for me that msync(MS_SYNC) flush every page on disk in single IO >>>> transaction. If we multiply 4K and 37 we get 150K. This number is size >>>> of >>>> the single transaction in my experience. >>>> >>>> +alc@, kib@ >>>> >>>> Am I right? Is there any plan to implement this? >>> Current buffer clustering code can only do only async writes. In fact, I >>> am not quite sure what would consitute the sync clustering, because the >>> ability to delay the write is important to be able to cluster at all. >>> >>> Also, I am not sure that lack of clustering is the biggest problem. >>> IMO, the fact that each write is sync is the first problem there. It >>> would be quite a work to add the tracking of the issued writes to the >>> vm_object_page_clean() and down the stack. Esp. due to custom page >>> write vops in several fses. >>> >>> The only guarantee that POSIX requires from msync(MS_SYNC) is that >>> the writes are finished when the syscall returned, and not that the >>> writes are done synchronously. Below is the hack which should help if >>> the msync()ed region contains the mapping of the whole file, since >>> it is possible to fsync() the file after all writes are scheduled >>> asynchronous then. It will causes unneeded metadata update, but I think >>> it would be much faster still. >>> >>> >>> diff --git a/sys/vm/vm_object.c b/sys/vm/vm_object.c >>> index 250b769..a9de554 100644 >>> --- a/sys/vm/vm_object.c >>> +++ b/sys/vm/vm_object.c >>> @@ -938,7 +938,7 @@ vm_object_sync(vm_object_t object, vm_ooffset_t >>> offset, vm_size_t size, >>> vm_object_t backing_object; >>> struct vnode *vp; >>> struct mount *mp; >>> - int flags; >>> + int flags, fsync_after; >>> >>> if (object == NULL) >>> return; >>> @@ -971,11 +971,26 @@ vm_object_sync(vm_object_t object, vm_ooffset_t >>> offset, vm_size_t size, >>> (void) vn_start_write(vp,&mp, V_WAIT); >>> vfslocked = VFS_LOCK_GIANT(vp->v_mount); >>> vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); >>> - flags = (syncio || invalidate) ? OBJPC_SYNC : 0; >>> - flags |= invalidate ? OBJPC_INVAL : 0; >>> + if (syncio&& !invalidate&& offset == 0&& >>> + OFF_TO_IDX(size) == object->size) { >>> + /* >>> + * If syncing the whole mapping of the file, >>> + * it is faster to schedule all the writes in >>> + * async mode, also allowing the clustering, >>> + * and then wait for i/o to complete. >>> + */ >>> + flags = 0; >>> + fsync_after = TRUE; >>> + } else { >>> + flags = (syncio || invalidate) ? OBJPC_SYNC : 0; >>> + flags |= invalidate ? (OBJPC_SYNC | OBJPC_INVAL) : 0; >>> + fsync_after = FALSE; >>> + } >>> VM_OBJECT_LOCK(object); >>> vm_object_page_clean(object, offset, offset + size, flags); >>> VM_OBJECT_UNLOCK(object); >>> + if (fsync_after) >>> + (void) VOP_FSYNC(vp, MNT_WAIT, curthread); >>> VOP_UNLOCK(vp, 0); >>> VFS_UNLOCK_GIANT(vfslocked); >>> vn_finished_write(mp); >> Thanks, this patch works. Performance is the same as of using fsync(). >> >> Actually, Linux uses fsync() inside of msync() if MS_SYNC is set. >> http://git.kernel.org/?p=linux/kernel/git/torvalds/linux.git;a=blob;f=mm/msync.c;h=632df4527c0122062d9332a0d483835274ed62f6;hb=HEAD >> > I see, indeed Linux fully fsync the whole file if even single page of it > appeared to be (non-shadowed) mmaped into the msync(MS_SYNC) region. > I am not sure that we shall follow this behaviour. > > Alan, do you agree with the patch above ? Yes, it's ok. Alan From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 08:19:12 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 893C11065675 for ; Fri, 23 Dec 2011 08:19:12 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id DE41A8FC0A for ; Fri, 23 Dec 2011 08:19:11 +0000 (UTC) Received: from alf.home (alf.kiev.zoral.com.ua [10.1.1.177]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id pBN8J4le070428 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 23 Dec 2011 10:19:04 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from alf.home (kostik@localhost [127.0.0.1]) by alf.home (8.14.5/8.14.5) with ESMTP id pBN8J3eo085063; Fri, 23 Dec 2011 10:19:03 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by alf.home (8.14.5/8.14.5/Submit) id pBN8J3aL085062; Fri, 23 Dec 2011 10:19:03 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: alf.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 23 Dec 2011 10:19:03 +0200 From: Kostik Belousov To: Charlie Martin Message-ID: <20111223081903.GF50300@deviant.kiev.zoral.com.ua> References: <4EF3B790.5050509@sgi.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wgLGSbGvrvJkgp+o" Content-Disposition: inline In-Reply-To: <4EF3B790.5050509@sgi.com> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-3.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: freebsd-stable@freebsd.org Subject: Re: Mystery panic, FreeBSD 7.2-PRE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 08:19:12 -0000 --wgLGSbGvrvJkgp+o Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Dec 22, 2011 at 04:04:48PM -0700, Charlie Martin wrote: > We've got another mystery panic in 7.2-PRE. Upgrading is not an option;= =20 > however, if this is familiar to anyone, backporting a patch would be. >=20 > The stack trace is: >=20 > db_trace_self_wrapper() at 0xffffffff8019120a =3D db_trace_self_wrapper+0= x2a^M > panic() at 0xffffffff80308797 =3D panic+0x187^M > devfs_populate_loop() at 0xffffffff802a45c8 =3D devfs_populate_loop+0x548= ^M > devfs_populate() at 0xffffffff802a46ab =3D devfs_populate+0x3b^M > devfs_lookup() at 0xffffffff802a7824 =3D devfs_lookup+0x264^M > VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts=20 > 24051, 7/9, > rc 0^M > KUP_APV() at 0xffffffff804d5995 =3D VOP_LOOKUP_APV+0x95^M > lookup() at 0xffffffff80384a3e =3D lookup+0x4ce^M > namei() at 0xffffffff80385768 =3D namei+0x2c8^M > vn_open_cred() at 0xffffffff8039b283 =3D vn_open_cred+0x1b3^M > kern_open() at 0xffffffff8039a4a0 =3D kern_open+0x110^M > syscall() at 0xffffffff804b0e3c =3D syscall+0x1ec^M > Xfast_syscall() at 0xffffffff80494ecb =3D Xfast_syscall+0xab^M > --- syscall (5, FreeBSD ELF64, open), rip =3D 0x800e022fc, rsp =3D=20 > 0x7fffffbfa128, > rbp =3D 0x801002240 ---^M > KDB: enter: panic^M It is impossible to diagnose the real cause of the panic from the backtrace above. 99.99% of the issues causing that backtrace are problems in the specific drivers, which failed to dev_ref() the newly created cdev, e.g. in the clone handler. My interest in the issue is limited to the slightest possibility that the bug is not yet fixed in HEAD or 9/8. Usual suspects are tty, which were completely rototiled in 8. --wgLGSbGvrvJkgp+o Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk70OXcACgkQC3+MBN1Mb4hxUwCggg53PzaN8uy0tFe3H6DG1hIG NJkAmwW93DOHjIivkuSXpPwpRFVmk2Le =etWn -----END PGP SIGNATURE----- --wgLGSbGvrvJkgp+o-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 10:38:39 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2E04E106575E for ; Fri, 23 Dec 2011 10:38:39 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 9E46D8FC19 for ; Fri, 23 Dec 2011 10:38:38 +0000 (UTC) Received: from vhoffman-macbooklocal.local ([10.10.10.20]) (authenticated bits=0) by unsane.co.uk (8.14.4/8.14.4) with ESMTP id pBNAcKPR056271 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 23 Dec 2011 10:38:20 GMT (envelope-from vince@unsane.co.uk) Message-ID: <4EF45A1B.1050505@unsane.co.uk> Date: Fri, 23 Dec 2011 10:38:19 +0000 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Garrett Cooper References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> <9706CBFC-9A69-4365-8883-FF45BDFDC108@gmail.com> In-Reply-To: <9706CBFC-9A69-4365-8883-FF45BDFDC108@gmail.com> X-Enigmail-Version: 1.3.4 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" , "freebsd-current@freebsd.org" , "igor@hybrid-lab.co.uk" , Alexander Leidinger , "freebsd-performance@freebsd.org" , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 10:38:39 -0000 On 23/12/2011 02:56, Garrett Cooper wrote: > On Dec 22, 2011, at 3:58 PM, Jeremy Chadwick wrote: > >> On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: >>> On 12/21/11 19:41, Alexander Leidinger wrote: >>>> Hi, >>>> >>>> while the discussion continued here, some work started at some other place. Now... in case someone here is willing to help instead of talking, feel free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look what can be improved. The page is far from perfect and needs some additional people which are willing to improve it. >>>> >>>> This is only part of the problem. A tuning page in the wiki - which could be referenced from the benchmark page - would be great too. Any volunteers? A first step would be to take he tuning-man-page and wikify it. Other tuning sources are welcome too. >>>> >>>> Every FreeBSD dev with a wiki account can hand out write access to the wiki. The benchmark page gives contributor-access. If someone wants write access create a FirstnameLastname account and ask here for contributor-access. >>>> >>>> Don't worry if you think your english is not good enough, even some one-word notes can help (and _my_ english got already corrected by other people on the benchmark page). >>>> >>>> Bye, >>>> Alexander. >>>> >>>> >>>> >>>> >>> Nice to see movement ;-) >>> >>> But there seems something unclear: >>> >>> man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in >>> /etc/make.conf. >>> The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. >>> >>> What's right and what's wrong now? >> I can say with certainty that this value belongs in /etc/make.conf >> (on RELENG_8 and earlier at least). >> >> src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, >> so, this is definitely a make.conf variable. > Take the advice in tuning(7) with a grain of salt because a number of suggestions are really outdated. I know because I filed a PR last night after I saw how out of synch some of the defaults it claimed were with reality on 9.x+. And I know other suggestions in the manpage are dated as well ;/. There is a wiki page http://wiki.freebsd.org/SystemTuning which is currently more or less tuning(7) with some annotations, the idea being to sort out whats outdated/invalid with an aim of rewriting tuning(7) to be more accurate and useful. I'll grab any info in your pr thats not up there already to keep it updated if thats ok. Vince > Thanks, > -Garrett_______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 15:00:07 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 922F01065670; Fri, 23 Dec 2011 15:00:07 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 3D2D78FC14; Fri, 23 Dec 2011 15:00:07 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) by cyrus.watson.org (Postfix) with ESMTPSA id DF7EB46B09; Fri, 23 Dec 2011 10:00:06 -0500 (EST) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 6ED65B955; Fri, 23 Dec 2011 10:00:06 -0500 (EST) From: John Baldwin To: freebsd-stable@freebsd.org Date: Fri, 23 Dec 2011 10:00:05 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p8; KDE/4.5.5; amd64; ; ) References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> In-Reply-To: <20111222235846.GA6071@icarus.home.lan> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201112231000.05712.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Fri, 23 Dec 2011 10:00:06 -0500 (EST) Cc: freebsd-current@freebsd.org, igor@hybrid-lab.co.uk, Alexander Leidinger , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 15:00:07 -0000 On Thursday, December 22, 2011 6:58:46 pm Jeremy Chadwick wrote: > On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: > > On 12/21/11 19:41, Alexander Leidinger wrote: > > > Hi, > > > > > > while the discussion continued here, some work started at some other place. Now... in case someone here is willing to help instead of talking, feel free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look what can be improved. The page is far from perfect and needs some additional people which are willing to improve it. > > > > > > This is only part of the problem. A tuning page in the wiki - which could be referenced from the benchmark page - would be great too. Any volunteers? A first step would be to take he tuning-man-page and wikify it. Other tuning sources are welcome too. > > > > > > Every FreeBSD dev with a wiki account can hand out write access to the wiki. The benchmark page gives contributor-access. If someone wants write access create a FirstnameLastname account and ask here for contributor-access. > > > > > > Don't worry if you think your english is not good enough, even some one- word notes can help (and _my_ english got already corrected by other people on the benchmark page). > > > > > > Bye, > > > Alexander. > > > > > > > > > > > > > > > > Nice to see movement ;-) > > > > But there seems something unclear: > > > > man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in > > /etc/make.conf. > > The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. > > > > What's right and what's wrong now? > > I can say with certainty that this value belongs in /etc/make.conf > (on RELENG_8 and earlier at least). > > src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, > so, this is definitely a make.conf variable. Eh, normal make variables can go in src.conf as well. They do not have to be listed in bsd.own.mk. World builds include /etc/src.conf whereas every make invocation includes /etc/make.conf via sys.mk. The only reason to use /etc/src.conf is to have a place to put variables only affect make buildworld / buildkernel but do not affect other make invocations. Also, MALLOC_PRODUCTION is generally enabled in a stable branch as part of making the stable branch, there should be no need to set it manually in a stable branch. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 15:24:55 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 400F21065672 for ; Fri, 23 Dec 2011 15:24:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta06.emeryville.ca.mail.comcast.net (qmta06.emeryville.ca.mail.comcast.net [76.96.30.56]) by mx1.freebsd.org (Postfix) with ESMTP id 22DF38FC1D for ; Fri, 23 Dec 2011 15:24:54 +0000 (UTC) Received: from omta15.emeryville.ca.mail.comcast.net ([76.96.30.71]) by qmta06.emeryville.ca.mail.comcast.net with comcast id Cepb1i0021Y3wxoA6fQocT; Fri, 23 Dec 2011 15:24:48 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta15.emeryville.ca.mail.comcast.net with comcast id Cfml1i0171t3BNj8bfmlmr; Fri, 23 Dec 2011 15:46:46 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id BC566102C19; Fri, 23 Dec 2011 07:24:52 -0800 (PST) Date: Fri, 23 Dec 2011 07:24:52 -0800 From: Jeremy Chadwick To: John Baldwin Message-ID: <20111223152452.GA21957@icarus.home.lan> References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> <201112231000.05712.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201112231000.05712.jhb@freebsd.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org, freebsd-current@freebsd.org, igor@hybrid-lab.co.uk, Alexander Leidinger , freebsd-performance@freebsd.org, "O. Hartmann" Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 15:24:55 -0000 On Fri, Dec 23, 2011 at 10:00:05AM -0500, John Baldwin wrote: > On Thursday, December 22, 2011 6:58:46 pm Jeremy Chadwick wrote: > > On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: > > > On 12/21/11 19:41, Alexander Leidinger wrote: > > > > Hi, > > > > > > > > while the discussion continued here, some work started at some other > place. Now... in case someone here is willing to help instead of talking, feel > free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look what can > be improved. The page is far from perfect and needs some additional people > which are willing to improve it. > > > > > > > > This is only part of the problem. A tuning page in the wiki - which > could be referenced from the benchmark page - would be great too. Any > volunteers? A first step would be to take he tuning-man-page and wikify it. > Other tuning sources are welcome too. > > > > > > > > Every FreeBSD dev with a wiki account can hand out write access to the > wiki. The benchmark page gives contributor-access. If someone wants write > access create a FirstnameLastname account and ask here for contributor-access. > > > > > > > > Don't worry if you think your english is not good enough, even some one- > word notes can help (and _my_ english got already corrected by other people on > the benchmark page). > > > > > > > > Bye, > > > > Alexander. > > > > > > > > > > > > > > > > > > > > > > Nice to see movement ;-) > > > > > > But there seems something unclear: > > > > > > man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in > > > /etc/make.conf. > > > The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. > > > > > > What's right and what's wrong now? > > > > I can say with certainty that this value belongs in /etc/make.conf > > (on RELENG_8 and earlier at least). > > > > src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, > > so, this is definitely a make.conf variable. > > Eh, normal make variables can go in src.conf as well. They do not have > to be listed in bsd.own.mk. World builds include /etc/src.conf whereas > every make invocation includes /etc/make.conf via sys.mk. The only reason > to use /etc/src.conf is to have a place to put variables only affect > make buildworld / buildkernel but do not affect other make invocations. I was always under the impression src.conf(5) variables had to be manually added to bsd.own.mk and similar bits (e.g. src/tools/build/options/WITH_xxx which is what's used to create the src.conf(5) man page), but upon your comment and manual investigation on my part, I found you're indeed right. Taken from bsd.own.mk: 107 .if !defined(_WITHOUT_SRCCONF) 108 SRCCONF?= /etc/src.conf 109 .if exists(${SRCCONF}) 110 .include "${SRCCONF}" 111 .endif 112 .endif As long as third-party software doesn't depend on MALLOC_PRODUCTION for something (I don't know why something would, but who knows; maybe there's a third-party malloc implementation which might?), then putting it in src.conf would be fine (src/lib/libc/stdlib files reference it). -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:08:02 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8871106567A for ; Fri, 23 Dec 2011 16:08:02 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 854088FC26 for ; Fri, 23 Dec 2011 16:08:02 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so17781923wgb.31 for ; Fri, 23 Dec 2011 08:08:01 -0800 (PST) Received: by 10.216.131.13 with SMTP id l13mr8450464wei.45.1324656480008; Fri, 23 Dec 2011 08:08:00 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id ep13sm14164306wbb.8.2011.12.23.08.07.57 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 08:07:57 -0800 (PST) Message-ID: <4EF4A75C.2040609@my.gd> Date: Fri, 23 Dec 2011 17:07:56 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: "freebsd-stable@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:08:03 -0000 Hey up list, Look, just a rant here. Who in *HELL* thought it would be a cool idea to release no less than FOUR security advisories today ? I mean, couldn't this have waited and remained undisclosed until monday ? I for one do *NOT* relish the idea of updating 50+ boxes this evening and tomorrow ! Not to mention a whole lot of merchants and banks have toggled IT Freeze a few weeks ago, to ensure xmas shopping doesn't get disturbed by production changes. Seriously, this is just irritating. /flame From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:39:28 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 16004106568B for ; Fri, 23 Dec 2011 16:39:28 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id E112F8FC2F for ; Fri, 23 Dec 2011 16:39:27 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [96.47.65.170]) by cyrus.watson.org (Postfix) with ESMTPSA id 8CA6846B3F; Fri, 23 Dec 2011 11:39:27 -0500 (EST) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 231DFB93F; Fri, 23 Dec 2011 11:39:27 -0500 (EST) From: John Baldwin To: freebsd-stable@freebsd.org Date: Fri, 23 Dec 2011 11:39:26 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p8; KDE/4.5.5; amd64; ; ) References: <4EF4A75C.2040609@my.gd> In-Reply-To: <4EF4A75C.2040609@my.gd> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Message-Id: <201112231139.26613.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Fri, 23 Dec 2011 11:39:27 -0500 (EST) Cc: Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:39:28 -0000 On Friday, December 23, 2011 11:07:56 am Damien Fleuriot wrote: > Hey up list, >=20 >=20 >=20 > Look, just a rant here. >=20 >=20 > Who in *HELL* thought it would be a cool idea to release no less than > FOUR security advisories today ? >=20 > I mean, couldn't this have waited and remained undisclosed until monday ? >=20 > I for one do *NOT* relish the idea of updating 50+ boxes this evening > and tomorrow ! >=20 >=20 > Not to mention a whole lot of merchants and banks have toggled IT Freeze > a few weeks ago, to ensure xmas shopping doesn't get disturbed by > production changes. >=20 >=20 > Seriously, this is just irritating. =46rom an e-mail sent to security@ from the security officer: Hi all, No, the Grinch didn't steal the FreeBSD security officer GPG key, and your = eyes aren't deceiving you: We really did just send out 5 security advisories. The timing, to put it bluntly, sucks. We normally aim to release advisorie= s on Wednesdays in order to maximize the number of system administrators who wil= l be at work already; and we try very hard to avoid issuing advisories any time = close to holidays for the same reason. The start of the Christmas weekend -- in = some parts of the world it's already Saturday -- is absolutely not when we want = to be releasing security advisories. Unfortunately my hand was forced: One of the issues (FreeBSD-SA-11:08.telne= td) is a remote root vulnerability which is being actively exploited in the wil= d; bugs really don't come any worse than this. On the positive side, most peo= ple have moved past telnet and on to SSH by now; but this is still not an issue= we could postpone until a more convenient time. While I'm writing, a note to freebsd-update users: FreeBSD-SA-11:07.chroot = has a rather messy fix involving adding a new interface to libc; this has the awk= ward side effect of causing the sizes of some "symbols" (aka. functions) in libc= to change, resulting in cascading changes into many binaries. The long list of updated files is irritating, but isn't a sign that anything in freebsd-upda= te went wrong. =2D-=20 John Baldwin From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:42:17 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D42891065686 for ; Fri, 23 Dec 2011 16:42:17 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 6F8D78FC1B for ; Fri, 23 Dec 2011 16:42:16 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so17830717wgb.31 for ; Fri, 23 Dec 2011 08:42:15 -0800 (PST) Received: by 10.227.206.4 with SMTP id fs4mr14970184wbb.21.1324658535494; Fri, 23 Dec 2011 08:42:15 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id en10sm10355513wbb.11.2011.12.23.08.42.14 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 08:42:14 -0800 (PST) Message-ID: <4EF4AF65.7010404@my.gd> Date: Fri, 23 Dec 2011 17:42:13 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: John Baldwin References: <4EF4A75C.2040609@my.gd> <201112231139.26613.jhb@freebsd.org> In-Reply-To: <201112231139.26613.jhb@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:42:17 -0000 On 12/23/11 5:39 PM, John Baldwin wrote: > On Friday, December 23, 2011 11:07:56 am Damien Fleuriot wrote: >> Hey up list, >> >> >> >> Look, just a rant here. >> >> >> Who in *HELL* thought it would be a cool idea to release no less than >> FOUR security advisories today ? >> >> I mean, couldn't this have waited and remained undisclosed until monday ? >> >> I for one do *NOT* relish the idea of updating 50+ boxes this evening >> and tomorrow ! >> >> >> Not to mention a whole lot of merchants and banks have toggled IT Freeze >> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >> production changes. >> >> >> Seriously, this is just irritating. > > From an e-mail sent to security@ from the security officer: > > > Hi all, > > No, the Grinch didn't steal the FreeBSD security officer GPG key, and your eyes > aren't deceiving you: We really did just send out 5 security advisories. > > The timing, to put it bluntly, sucks. We normally aim to release advisories on > Wednesdays in order to maximize the number of system administrators who will be > at work already; and we try very hard to avoid issuing advisories any time close > to holidays for the same reason. The start of the Christmas weekend -- in some > parts of the world it's already Saturday -- is absolutely not when we want to be > releasing security advisories. > > Unfortunately my hand was forced: One of the issues (FreeBSD-SA-11:08.telnetd) > is a remote root vulnerability which is being actively exploited in the wild; > bugs really don't come any worse than this. On the positive side, most people > have moved past telnet and on to SSH by now; but this is still not an issue we > could postpone until a more convenient time. > > While I'm writing, a note to freebsd-update users: FreeBSD-SA-11:07.chroot has a > rather messy fix involving adding a new interface to libc; this has the awkward > side effect of causing the sizes of some "symbols" (aka. functions) in libc to > change, resulting in cascading changes into many binaries. The long list of > updated files is irritating, but isn't a sign that anything in freebsd-update > went wrong. > > At least they're aware the timing sucks completely and feel as sorry as us. Ty John. From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:47:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 962931065673 for ; Fri, 23 Dec 2011 16:47:50 +0000 (UTC) (envelope-from lists@rewt.org.uk) Received: from abby.lhr1.as41113.net (abby.lhr1.as41113.net [91.208.177.20]) by mx1.freebsd.org (Postfix) with ESMTP id 5AA428FC1D for ; Fri, 23 Dec 2011 16:47:50 +0000 (UTC) Received: from jasmine.internethq (unknown [91.208.177.192]) by abby.lhr1.as41113.net (Postfix) with ESMTP id 7DC1A22837 for ; Fri, 23 Dec 2011 16:47:49 +0000 (UTC) Received: from [172.16.11.44] (jwh-laptop.internethq [172.16.11.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by jasmine.internethq (Postfix) with ESMTPS id 5EBE41065B001; Fri, 23 Dec 2011 16:47:51 +0000 (GMT) Message-ID: <4EF4B0B2.10709@rewt.org.uk> Date: Fri, 23 Dec 2011 16:47:46 +0000 From: Joe Holden User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Damien Fleuriot References: <4EF4A75C.2040609@my.gd> In-Reply-To: <4EF4A75C.2040609@my.gd> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:47:50 -0000 So don't update until Monday? The outcome will be the same :) Damien Fleuriot wrote: > Hey up list, > > > > Look, just a rant here. > > > Who in *HELL* thought it would be a cool idea to release no less than > FOUR security advisories today ? > > I mean, couldn't this have waited and remained undisclosed until monday ? > > I for one do *NOT* relish the idea of updating 50+ boxes this evening > and tomorrow ! > > > Not to mention a whole lot of merchants and banks have toggled IT Freeze > a few weeks ago, to ensure xmas shopping doesn't get disturbed by > production changes. > > > Seriously, this is just irritating. > > > /flame > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:50:09 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49DEB10656E8 for ; Fri, 23 Dec 2011 16:50:09 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id D215E8FC13 for ; Fri, 23 Dec 2011 16:50:08 +0000 (UTC) Received: by wibhr1 with SMTP id hr1so6529516wib.13 for ; Fri, 23 Dec 2011 08:50:08 -0800 (PST) Received: by 10.180.77.42 with SMTP id p10mr34260248wiw.5.1324659007994; Fri, 23 Dec 2011 08:50:07 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id d17sm14279517wbh.19.2011.12.23.08.50.06 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 08:50:07 -0800 (PST) Message-ID: <4EF4B13E.2020109@my.gd> Date: Fri, 23 Dec 2011 17:50:06 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Joe Holden References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> In-Reply-To: <4EF4B0B2.10709@rewt.org.uk> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:50:09 -0000 My point (which may or may not be valid) was that if the vulnerabilities remained *undisclosed*, they would have a much lower chance of being exploited. On 12/23/11 5:47 PM, Joe Holden wrote: > So don't update until Monday? The outcome will be the same :) > > Damien Fleuriot wrote: >> Hey up list, >> >> >> >> Look, just a rant here. >> >> >> Who in *HELL* thought it would be a cool idea to release no less than >> FOUR security advisories today ? >> >> I mean, couldn't this have waited and remained undisclosed until monday ? >> >> I for one do *NOT* relish the idea of updating 50+ boxes this evening >> and tomorrow ! >> >> >> Not to mention a whole lot of merchants and banks have toggled IT Freeze >> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >> production changes. >> >> >> Seriously, this is just irritating. >> >> >> /flame >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:52:15 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6110410657EC for ; Fri, 23 Dec 2011 16:52:15 +0000 (UTC) (envelope-from lists@rewt.org.uk) Received: from abby.lhr1.as41113.net (abby.lhr1.as41113.net [91.208.177.20]) by mx1.freebsd.org (Postfix) with ESMTP id 191DE8FC1D for ; Fri, 23 Dec 2011 16:52:15 +0000 (UTC) Received: from jasmine.internethq (unknown [91.208.177.192]) by abby.lhr1.as41113.net (Postfix) with ESMTP id 11CAB22837 for ; Fri, 23 Dec 2011 16:52:14 +0000 (UTC) Received: from [172.16.11.44] (jwh-laptop.internethq [172.16.11.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by jasmine.internethq (Postfix) with ESMTPS id E04471065B001; Fri, 23 Dec 2011 16:52:15 +0000 (GMT) Message-ID: <4EF4B1BA.8040206@rewt.org.uk> Date: Fri, 23 Dec 2011 16:52:10 +0000 From: Joe Holden User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Damien Fleuriot References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> <4EF4B13E.2020109@my.gd> In-Reply-To: <4EF4B13E.2020109@my.gd> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:52:15 -0000 The serious one (telnetd) is already being exploited in the wild, and if you're running telnetd anyway then you can always switch to ssh or acl the port, either way it is a relative non-issue to ignore the update for now... Damien Fleuriot wrote: > My point (which may or may not be valid) was that if the vulnerabilities > remained *undisclosed*, they would have a much lower chance of being > exploited. > > > > On 12/23/11 5:47 PM, Joe Holden wrote: >> So don't update until Monday? The outcome will be the same :) >> >> Damien Fleuriot wrote: >>> Hey up list, >>> >>> >>> >>> Look, just a rant here. >>> >>> >>> Who in *HELL* thought it would be a cool idea to release no less than >>> FOUR security advisories today ? >>> >>> I mean, couldn't this have waited and remained undisclosed until monday ? >>> >>> I for one do *NOT* relish the idea of updating 50+ boxes this evening >>> and tomorrow ! >>> >>> >>> Not to mention a whole lot of merchants and banks have toggled IT Freeze >>> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >>> production changes. >>> >>> >>> Seriously, this is just irritating. >>> >>> >>> /flame >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:52:29 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1791C10656B3 for ; Fri, 23 Dec 2011 16:52:29 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1.freebsd.org (Postfix) with ESMTP id A53D38FC19 for ; Fri, 23 Dec 2011 16:52:28 +0000 (UTC) Received: by wibhr1 with SMTP id hr1so6532164wib.13 for ; Fri, 23 Dec 2011 08:52:27 -0800 (PST) Received: by 10.181.13.17 with SMTP id eu17mr34217307wid.12.1324659147812; Fri, 23 Dec 2011 08:52:27 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id en10sm10386136wbb.11.2011.12.23.08.52.26 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 08:52:27 -0800 (PST) Message-ID: <4EF4B1CA.4080800@my.gd> Date: Fri, 23 Dec 2011 17:52:26 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Stephen Montgomery-Smith References: <4EF4A75C.2040609@my.gd> <4EF4B151.4040400@missouri.edu> In-Reply-To: <4EF4B151.4040400@missouri.edu> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:52:29 -0000 On 12/23/11 5:50 PM, Stephen Montgomery-Smith wrote: > On 12/23/2011 10:07 AM, Damien Fleuriot wrote: >> Hey up list, >> >> >> >> Look, just a rant here. >> >> >> Who in *HELL* thought it would be a cool idea to release no less than >> FOUR security advisories today ? > > After receiving the fifth security advisory in a few moments, you will > get a Christmas message from the Security Advisory team, which will > both apologize and explain why these untimely advisories came today. > > http://lists.freebsd.org/pipermail/freebsd-security-notifications/2011-December/thread.html > Indeed, just read the one John copied. Still sucks, but at least they're aware and apologetic about how the timing completely blows. Happy xmas. From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:57:06 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C08E5106568E for ; Fri, 23 Dec 2011 16:57:06 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 5E6BC8FC0A for ; Fri, 23 Dec 2011 16:57:06 +0000 (UTC) Received: by werb13 with SMTP id b13so7743252wer.13 for ; Fri, 23 Dec 2011 08:57:05 -0800 (PST) Received: by 10.216.133.234 with SMTP id q84mr8547127wei.30.1324659425295; Fri, 23 Dec 2011 08:57:05 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id ff10sm14317843wbb.6.2011.12.23.08.57.04 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 08:57:04 -0800 (PST) Message-ID: <4EF4B2DF.6000201@my.gd> Date: Fri, 23 Dec 2011 17:57:03 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Bas Smeelen References: <20111223165410.5ec6a722@mail.ose.nl> In-Reply-To: <20111223165410.5ec6a722@mail.ose.nl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:57:06 -0000 On 12/23/11 5:54 PM, Bas Smeelen wrote: >> Look, just a rant here. > > >> Who in *HELL* thought it would be a cool idea to release no less than >> FOUR security advisories today ? > What's the impact for your boxes? > Only the BIND exploit concerns me, means that *potentially* servers for my projects might be unable to run DNS resolution anymore -> prod problems. I don't think we'll be getting trouble though so I'm postponing the update until next week. >> I mean, couldn't this have waited and remained undisclosed until monday ? > Best time to exploit is Christmas/holidays > >> I for one do *NOT* relish the idea of updating 50+ boxes this evening >> and tomorrow ! > updating 30 boxes right now > >> Not to mention a whole lot of merchants and banks have toggled IT Freeze >> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >> production changes. > > >> Seriously, this is just irritating. > If you don't use telnet, ftpd, dns, pam, then it's not a big problem > > merry Christmas > > Disclaimer: http://www.ose.nl/email > From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 16:57:09 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0B9CD106566B for ; Fri, 23 Dec 2011 16:57:09 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id C334F8FC19 for ; Fri, 23 Dec 2011 16:57:08 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id pBNGv69G016866; Fri, 23 Dec 2011 11:57:06 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <4EF4B2D6.5090206@sentex.net> Date: Fri, 23 Dec 2011 11:56:54 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Damien Fleuriot References: <4EF4A75C.2040609@my.gd> In-Reply-To: <4EF4A75C.2040609@my.gd> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.71 on IPv6:2607:f3e0:0:1::12 Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 16:57:09 -0000 On 12/23/2011 11:07 AM, Damien Fleuriot wrote: > Hey up list, > Look, just a rant here. > Who in *HELL* thought it would be a cool idea to release no less than > FOUR security advisories today ? The Security Officer explained it was because one of them was being actively exploited. http://lists.freebsd.org/pipermail/freebsd-security-notifications/2011-December/000165.html Also, the chroot issue has been public for some time along with sample exploits. Same with BIND which was fixed some time ago. Judgment call, and I think they made the right call at least from my perspective. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:03:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 713D3106566C for ; Fri, 23 Dec 2011 17:03:11 +0000 (UTC) (envelope-from lattera@gmail.com) Received: from mail-tul01m020-f182.google.com (mail-tul01m020-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3C7AB8FC24 for ; Fri, 23 Dec 2011 17:03:11 +0000 (UTC) Received: by obbwd18 with SMTP id wd18so7936766obb.13 for ; Fri, 23 Dec 2011 09:03:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+K0XgpQcypnUtngoXFROc/gnCkvIRk38o+eT2Tb3g1I=; b=RzSFxgCthdUyixU4ctNKkFhK9VenaQ0dn9AfhziLmRIhRxpS5/zc2sZrgZwgoTkxZO DIQo6T0wp/GCo/qwdww1Y2zB+mWsrHP1cOFRyZGGe20KBNcw7hgyNbTzCfA6MnLgVlEF WYRBux3qsBq1Br/sGonbVCSP3fVHAyGJ77IXo= MIME-Version: 1.0 Received: by 10.182.227.7 with SMTP id rw7mr13438206obc.70.1324659790768; Fri, 23 Dec 2011 09:03:10 -0800 (PST) Received: by 10.182.56.134 with HTTP; Fri, 23 Dec 2011 09:03:10 -0800 (PST) In-Reply-To: <4EF4B13E.2020109@my.gd> References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> <4EF4B13E.2020109@my.gd> Date: Fri, 23 Dec 2011 10:03:10 -0700 Message-ID: From: Shawn Webb To: Damien Fleuriot Content-Type: text/plain; charset=ISO-8859-1 Cc: Joe Holden , "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:03:11 -0000 Some people (like me) already knew about the vulnerabilities. And others are already exploiting some of these vulnerabilities. Thanks, Shawn Webb On Fri, Dec 23, 2011 at 9:50 AM, Damien Fleuriot wrote: > My point (which may or may not be valid) was that if the vulnerabilities > remained *undisclosed*, they would have a much lower chance of being > exploited. > > > > On 12/23/11 5:47 PM, Joe Holden wrote: >> So don't update until Monday? The outcome will be the same :) >> >> Damien Fleuriot wrote: >>> Hey up list, >>> >>> >>> >>> Look, just a rant here. >>> >>> >>> Who in *HELL* thought it would be a cool idea to release no less than >>> FOUR security advisories today ? >>> >>> I mean, couldn't this have waited and remained undisclosed until monday ? >>> >>> I for one do *NOT* relish the idea of updating 50+ boxes this evening >>> and tomorrow ! >>> >>> >>> Not to mention a whole lot of merchants and banks have toggled IT Freeze >>> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >>> production changes. >>> >>> >>> Seriously, this is just irritating. >>> >>> >>> /flame >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:04:15 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 19FF4106566B for ; Fri, 23 Dec 2011 17:04:15 +0000 (UTC) (envelope-from b.smeelen@ose.nl) Received: from mail.ose.nl (mail.ose.nl [212.178.134.164]) by mx1.freebsd.org (Postfix) with ESMTP id AD24F8FC17 for ; Fri, 23 Dec 2011 17:04:14 +0000 (UTC) X-Footer: b3NlLm5s Received: from localhost ([127.0.0.1]) by mail.ose.nl; Fri, 23 Dec 2011 17:54:10 +0100 From: "Bas Smeelen" To: "Damien Fleuriot" , freebsd-stable@freebsd.org In-Reply-To: <4EF4A75C.2040609@my.gd> Message-ID: <20111223165410.5ec6a722@mail.ose.nl> Date: Fri, 23 Dec 2011 17:54:10 +0100 X-User-Agent: Mozilla/5.0 (Ubuntu; X11; Linux i686; rv:8.0) Gecko/20100101 Firefox/8.0 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Cc: Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:04:15 -0000 >Look, just a rant here. >Who in *HELL* thought it would be a cool idea to release no less than >FOUR security advisories today ? What's the impact for your boxes? >I mean, couldn't this have waited and remained undisclosed until monday ? Best time to exploit is Christmas/holidays >I for one do *NOT* relish the idea of updating 50+ boxes this evening >and tomorrow ! updating 30 boxes right now >Not to mention a whole lot of merchants and banks have toggled IT Freeze >a few weeks ago, to ensure xmas shopping doesn't get disturbed by >production changes. >Seriously, this is just irritating. If you don't use telnet, ftpd, dns, pam, then it's not a big problem merry Christmas Disclaimer: http://www.ose.nl/email From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:05:46 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4E8C01065670 for ; Fri, 23 Dec 2011 17:05:46 +0000 (UTC) (envelope-from karl@denninger.net) Received: from FS.denninger.net (wsip-70-169-168-7.pn.at.cox.net [70.169.168.7]) by mx1.freebsd.org (Postfix) with ESMTP id 17B418FC12 for ; Fri, 23 Dec 2011 17:05:46 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) by FS.denninger.net (8.14.4/8.13.1) with ESMTP id pBNGreF2035545 for ; Fri, 23 Dec 2011 10:53:41 -0600 (CST) (envelope-from karl@denninger.net) Received: from [127.0.0.1] [192.168.1.40] by Spamblock-sys (LOCAL); Fri Dec 23 10:53:40 2011 Message-ID: <4EF4B214.2070106@denninger.net> Date: Fri, 23 Dec 2011 10:53:40 -0600 From: Karl Denninger User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: John Baldwin References: <4EF4A75C.2040609@my.gd> <201112231139.26613.jhb@freebsd.org> In-Reply-To: <201112231139.26613.jhb@freebsd.org> X-Enigmail-Version: 1.3.4 X-Antivirus: avast! (VPS 111223-0, 12/23/2011), Outbound message X-Antivirus-Status: Clean Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:05:46 -0000 I happen to APPLAUD the FreeBSD Security team for doing this. I WANT security fixes out as soon as reasonably possible. You're NOT telling the bad guys anything they don't already know, but you ARE making it possible for the good guys to raise shields. A "remote root" problem is about as bad as it gets. -- Karl Denninger /The Market Ticker/ On 12/23/2011 10:39 AM, John Baldwin wrote: > On Friday, December 23, 2011 11:07:56 am Damien Fleuriot wrote: >> Hey up list, >> >> >> >> Look, just a rant here. >> >> >> Who in *HELL* thought it would be a cool idea to release no less than >> FOUR security advisories today ? >> >> I mean, couldn't this have waited and remained undisclosed until monday ? >> >> I for one do *NOT* relish the idea of updating 50+ boxes this evening >> and tomorrow ! >> >> >> Not to mention a whole lot of merchants and banks have toggled IT Freeze >> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >> production changes. >> >> >> Seriously, this is just irritating. > From an e-mail sent to security@ from the security officer: > > > Hi all, > > No, the Grinch didn't steal the FreeBSD security officer GPG key, and your eyes > aren't deceiving you: We really did just send out 5 security advisories. > > The timing, to put it bluntly, sucks. We normally aim to release advisories on > Wednesdays in order to maximize the number of system administrators who will be > at work already; and we try very hard to avoid issuing advisories any time close > to holidays for the same reason. The start of the Christmas weekend -- in some > parts of the world it's already Saturday -- is absolutely not when we want to be > releasing security advisories. > > Unfortunately my hand was forced: One of the issues (FreeBSD-SA-11:08.telnetd) > is a remote root vulnerability which is being actively exploited in the wild; > bugs really don't come any worse than this. On the positive side, most people > have moved past telnet and on to SSH by now; but this is still not an issue we > could postpone until a more convenient time. > > While I'm writing, a note to freebsd-update users: FreeBSD-SA-11:07.chroot has a > rather messy fix involving adding a new interface to libc; this has the awkward > side effect of causing the sizes of some "symbols" (aka. functions) in libc to > change, resulting in cascading changes into many binaries. The long list of > updated files is irritating, but isn't a sign that anything in freebsd-update > went wrong. > > From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:06:21 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E648010657AD for ; Fri, 23 Dec 2011 17:06:21 +0000 (UTC) (envelope-from stephen@missouri.edu) Received: from wilberforce.math.missouri.edu (wilberforce.math.missouri.edu [128.206.184.213]) by mx1.freebsd.org (Postfix) with ESMTP id 937D28FC15 for ; Fri, 23 Dec 2011 17:06:21 +0000 (UTC) Received: from [127.0.0.1] (wilberforce.math.missouri.edu [128.206.184.213]) by wilberforce.math.missouri.edu (8.14.5/8.14.5) with ESMTP id pBNGoP4O042674; Fri, 23 Dec 2011 10:50:26 -0600 (CST) (envelope-from stephen@missouri.edu) Message-ID: <4EF4B151.4040400@missouri.edu> Date: Fri, 23 Dec 2011 10:50:25 -0600 From: Stephen Montgomery-Smith User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.23) Gecko/20110921 Thunderbird/3.1.15 MIME-Version: 1.0 To: Damien Fleuriot References: <4EF4A75C.2040609@my.gd> In-Reply-To: <4EF4A75C.2040609@my.gd> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:06:22 -0000 On 12/23/2011 10:07 AM, Damien Fleuriot wrote: > Hey up list, > > > > Look, just a rant here. > > > Who in *HELL* thought it would be a cool idea to release no less than > FOUR security advisories today ? After receiving the fifth security advisory in a few moments, you will get a Christmas message from the Security Advisory team, which will both apologize and explain why these untimely advisories came today. http://lists.freebsd.org/pipermail/freebsd-security-notifications/2011-December/thread.html From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:19:12 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 262AB106566B; Fri, 23 Dec 2011 17:19:12 +0000 (UTC) (envelope-from m.e.sanliturk@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id D7EB28FC1A; Fri, 23 Dec 2011 17:19:11 +0000 (UTC) Received: by iadj38 with SMTP id j38so17543656iad.13 for ; Fri, 23 Dec 2011 09:19:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=8AeuF+DzEDEAhAhpXSNZCpwU+A1G8L61Q4G9U+pkhjo=; b=NbubMqR+ow7lqMBOLC2pDdlHnpcj+rShp/b1HHOK/B/T4bSE1gRVs2wWHy9lu56XT7 7rNcJZjU5g1zlN+LNXnJZvK6BZ2dp2F0IXfhgmF6geRbS98tmR09E0L9RIKc5dftJJ/H 26tA3Kd4J9ZJ+RiSe42I4eyi5zQuOshYUuDEM= MIME-Version: 1.0 Received: by 10.50.181.197 with SMTP id dy5mr14675785igc.13.1324659411688; Fri, 23 Dec 2011 08:56:51 -0800 (PST) Received: by 10.42.166.201 with HTTP; Fri, 23 Dec 2011 08:56:51 -0800 (PST) In-Reply-To: <201112231139.26613.jhb@freebsd.org> References: <4EF4A75C.2040609@my.gd> <201112231139.26613.jhb@freebsd.org> Date: Fri, 23 Dec 2011 11:56:51 -0500 Message-ID: From: Mehmet Erol Sanliturk To: John Baldwin Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:19:12 -0000 On Fri, Dec 23, 2011 at 11:39 AM, John Baldwin wrote: > On Friday, December 23, 2011 11:07:56 am Damien Fleuriot wrote: > > Hey up list, > > > > > > > > Look, just a rant here. > > > > > > Who in *HELL* thought it would be a cool idea to release no less than > > FOUR security advisories today ? > > > > I mean, couldn't this have waited and remained undisclosed until monday ? > > > > I for one do *NOT* relish the idea of updating 50+ boxes this evening > > and tomorrow ! > > > > > > Not to mention a whole lot of merchants and banks have toggled IT Freeze > > a few weeks ago, to ensure xmas shopping doesn't get disturbed by > > production changes. > > > > > > Seriously, this is just irritating. > > From an e-mail sent to security@ from the security officer: > > > Hi all, > > No, the Grinch didn't steal the FreeBSD security officer GPG key, and your > eyes > aren't deceiving you: We really did just send out 5 security advisories. > > The timing, to put it bluntly, sucks. We normally aim to release > advisories on > Wednesdays in order to maximize the number of system administrators who > will be > at work already; and we try very hard to avoid issuing advisories any time > close > to holidays for the same reason. The start of the Christmas weekend -- in > some > parts of the world it's already Saturday -- is absolutely not when we want > to be > releasing security advisories. > > Unfortunately my hand was forced: One of the issues > (FreeBSD-SA-11:08.telnetd) > is a remote root vulnerability which is being actively exploited in the > wild; > bugs really don't come any worse than this. On the positive side, most > people > have moved past telnet and on to SSH by now; but this is still not an > issue we > could postpone until a more convenient time. > > While I'm writing, a note to freebsd-update users: FreeBSD-SA-11:07.chroot > has a > rather messy fix involving adding a new interface to libc; this has the > awkward > side effect of causing the sizes of some "symbols" (aka. functions) in > libc to > change, resulting in cascading changes into many binaries. The long list > of > updated files is irritating, but isn't a sign that anything in > freebsd-update > went wrong. > > > -- > John Baldwin > These vulnerabilities are known many days before in other distributions . Thank you very much . Mehmet Erol Sanliturk From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:22:56 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F0C0E106566C for ; Fri, 23 Dec 2011 17:22:56 +0000 (UTC) (envelope-from crmartin@sgi.com) Received: from relay.sgi.com (relay1.sgi.com [192.48.179.29]) by mx1.freebsd.org (Postfix) with ESMTP id BC5108FC12 for ; Fri, 23 Dec 2011 17:22:56 +0000 (UTC) Received: from xmail.sgi.com (pv-excas1-dc21-nlb.corp.sgi.com [137.38.102.126]) by relay1.corp.sgi.com (Postfix) with ESMTP id E2E818F807A; Fri, 23 Dec 2011 09:22:55 -0800 (PST) Received: from [10.3.0.220] (10.3.0.220) by xmail.sgi.com (137.38.102.30) with Microsoft SMTP Server (TLS) id 14.1.339.1; Fri, 23 Dec 2011 11:22:55 -0600 Message-ID: <4EF4B8EE.8070803@sgi.com> Date: Fri, 23 Dec 2011 10:22:54 -0700 From: Charlie Martin Organization: Silicon Graphics, Inc. User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111101 SUSE/3.1.16 Lightning/1.0b2 Thunderbird/3.1.16 MIME-Version: 1.0 To: Jeremy Chadwick References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> In-Reply-To: <20111223000705.GA6242@icarus.home.lan> Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.3.0.220] Cc: freebsd-stable@FreeBSD.org, "Peter W. Morreale" Subject: Re: Mystery panic, FreeBSD 7.2-PRE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:22:57 -0000 Thanks, jeremy! On 12/22/2011 05:07 PM, Jeremy Chadwick wrote: > On Thu, Dec 22, 2011 at 04:04:48PM -0700, Charlie Martin wrote: >> We've got another mystery panic in 7.2-PRE. Upgrading is not an >> option; however, if this is familiar to anyone, backporting a patch >> would be. >> >> The stack trace is: >> >> db_trace_self_wrapper() at 0xffffffff8019120a = db_trace_self_wrapper+0x2a^M >> panic() at 0xffffffff80308797 = panic+0x187^M >> devfs_populate_loop() at 0xffffffff802a45c8 = devfs_populate_loop+0x548^M >> devfs_populate() at 0xffffffff802a46ab = devfs_populate+0x3b^M >> devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M >> VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts >> 24051, 7/9, >> rc 0^M >> KUP_APV() at 0xffffffff804d5995 = VOP_LOOKUP_APV+0x95^M >> lookup() at 0xffffffff80384a3e = lookup+0x4ce^M >> namei() at 0xffffffff80385768 = namei+0x2c8^M >> vn_open_cred() at 0xffffffff8039b283 = vn_open_cred+0x1b3^M >> kern_open() at 0xffffffff8039a4a0 = kern_open+0x110^M >> syscall() at 0xffffffff804b0e3c = syscall+0x1ec^M >> Xfast_syscall() at 0xffffffff80494ecb = Xfast_syscall+0xab^M >> --- syscall (5, FreeBSD ELF64, open), rip = 0x800e022fc, rsp = >> 0x7fffffbfa128, >> rbp = 0x801002240 ---^M >> KDB: enter: panic^M > devfs(5) has been massively worked on in RELENG_8 and newer. You should > go through the below commits and see if you can find one that references > a PR with a similar backtrace, or mentions things like devfs_lookup(). > > http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/fs/devfs/ > > Also, be aware that the above stack trace is interspersed. Ultimately > you get to clean up the output yourself. This is a long-standing > problem with FreeBSD which can be helped but only slightly/barely by > using "options PRINTF_BUFR_SIZE=256" in your kernel configuration (the > default configs have a value of 128. Do not increase the value too > high, there are concerns about it causing major issues; I can dig up the > post that says that, but I'd rather not). It *will not* solve the > problem of interspersed output entirely. There still is no fix for this > problem... :-( > > What I'm referring to: > >> devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M >> VOP_LOO[24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts >> 24051, 7/9, >> rc 0^M >> lookup() at 0xffffffff80384a3e = lookup+0x4ce^M > This should actually read (I think): > >> devfs_lookup() at 0xffffffff802a7824 = devfs_lookup+0x264^M >> VOP_LOOKUP_APV() at 0xffffffff804d5995 = VOP_LOOKUP_APV+0x95^M >> [24165][irq261: plx0] DEBUG (hasc_sv_rcv_cb): rcvd hrtbt ts 24051, 7/9, rc 0^M -- Charles R. (Charlie) Martin Senior Software Engineer SGI logo 1900 Pike Road Longmont, CO 80501 Phone: 303-532-0209 E-Mail: CRMartin@sgi.com Website: www.sgi.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:25:24 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4796C1065675 for ; Fri, 23 Dec 2011 17:25:24 +0000 (UTC) (envelope-from stephen@missouri.edu) Received: from wilberforce.math.missouri.edu (wilberforce.math.missouri.edu [128.206.184.213]) by mx1.freebsd.org (Postfix) with ESMTP id E84398FC28 for ; Fri, 23 Dec 2011 17:25:23 +0000 (UTC) Received: from [127.0.0.1] (wilberforce.math.missouri.edu [128.206.184.213]) by wilberforce.math.missouri.edu (8.14.5/8.14.5) with ESMTP id pBNHPMLF044996 for ; Fri, 23 Dec 2011 11:25:23 -0600 (CST) (envelope-from stephen@missouri.edu) Message-ID: <4EF4B982.3070207@missouri.edu> Date: Fri, 23 Dec 2011 11:25:22 -0600 From: Stephen Montgomery-Smith User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.23) Gecko/20110921 Thunderbird/3.1.15 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> In-Reply-To: <4EF4B2D6.5090206@sentex.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:25:24 -0000 On 12/23/2011 10:56 AM, Mike Tancsa wrote: > Also, the chroot issue has been public for some time along with sample > exploits. Same with BIND which was fixed some time ago. Judgment call, > and I think they made the right call at least from my perspective. It is this chroot issue that bothers me. From my reading of the ftpd man page, if I have anonymous ftp to my server, it seems that I am using chroot with ftpd, and there is no way to stop this happening. Am I correct, or have I missed something? (I am hoping I missed something.) From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:25:59 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89C141065676 for ; Fri, 23 Dec 2011 17:25:59 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 1B86B8FC08 for ; Fri, 23 Dec 2011 17:25:58 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so17885194wgb.31 for ; Fri, 23 Dec 2011 09:25:58 -0800 (PST) Received: by 10.216.131.141 with SMTP id m13mr14050782wei.30.1324661158090; Fri, 23 Dec 2011 09:25:58 -0800 (PST) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id b5sm14405582wbh.4.2011.12.23.09.25.56 (version=SSLv3 cipher=OTHER); Fri, 23 Dec 2011 09:25:57 -0800 (PST) Message-ID: <4EF4B9A4.8060405@my.gd> Date: Fri, 23 Dec 2011 18:25:56 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Shawn Webb References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> <4EF4B13E.2020109@my.gd> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Joe Holden , "freebsd-stable@freebsd.org" Subject: Goo lists to subscribe to hear quickly about vulns ? ( was: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:25:59 -0000 On topic, where do you guys subscribe to know of these vulns ahead of their release on the ML ? I'm subscribed to the BIND ML but I don't recall seeing an advisory there ahead of today. On 12/23/11 6:03 PM, Shawn Webb wrote: > Some people (like me) already knew about the vulnerabilities. And > others are already exploiting some of these vulnerabilities. > > Thanks, > > Shawn Webb > > On Fri, Dec 23, 2011 at 9:50 AM, Damien Fleuriot wrote: >> My point (which may or may not be valid) was that if the vulnerabilities >> remained *undisclosed*, they would have a much lower chance of being >> exploited. >> >> >> >> On 12/23/11 5:47 PM, Joe Holden wrote: >>> So don't update until Monday? The outcome will be the same :) >>> >>> Damien Fleuriot wrote: >>>> Hey up list, >>>> >>>> >>>> >>>> Look, just a rant here. >>>> >>>> >>>> Who in *HELL* thought it would be a cool idea to release no less than >>>> FOUR security advisories today ? >>>> >>>> I mean, couldn't this have waited and remained undisclosed until monday ? >>>> >>>> I for one do *NOT* relish the idea of updating 50+ boxes this evening >>>> and tomorrow ! >>>> >>>> >>>> Not to mention a whole lot of merchants and banks have toggled IT Freeze >>>> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >>>> production changes. >>>> >>>> >>>> Seriously, this is just irritating. >>>> >>>> >>>> /flame >>>> _______________________________________________ >>>> freebsd-stable@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >>> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:26:43 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A15CC10656AD; Fri, 23 Dec 2011 17:26:43 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 41E138FC18; Fri, 23 Dec 2011 17:26:42 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1Re8tF-0003gF-Su>; Fri, 23 Dec 2011 18:26:41 +0100 Received: from e178023009.adsl.alicedsl.de ([85.178.23.9] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1Re8tF-00021A-NF>; Fri, 23 Dec 2011 18:26:41 +0100 Message-ID: <4EF4B9D1.8010900@zedat.fu-berlin.de> Date: Fri, 23 Dec 2011 18:26:41 +0100 From: "O. Hartmann" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:9.0) Gecko/20111222 Thunderbird/9.0 MIME-Version: 1.0 To: Jeremy Chadwick References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> <201112231000.05712.jhb@freebsd.org> <20111223152452.GA21957@icarus.home.lan> In-Reply-To: <20111223152452.GA21957@icarus.home.lan> X-Enigmail-Version: undefined Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig1502F529B2C0204E19EA4E4D" X-Originating-IP: 85.178.23.9 Cc: freebsd-stable@freebsd.org, John Baldwin , freebsd-current@freebsd.org, igor@hybrid-lab.co.uk, Alexander Leidinger , freebsd-performance@freebsd.org Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:26:43 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig1502F529B2C0204E19EA4E4D Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 12/23/11 16:24, Jeremy Chadwick wrote: > On Fri, Dec 23, 2011 at 10:00:05AM -0500, John Baldwin wrote: >> On Thursday, December 22, 2011 6:58:46 pm Jeremy Chadwick wrote: >>> On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: >>>> On 12/21/11 19:41, Alexander Leidinger wrote: >>>>> Hi, >>>>> >>>>> while the discussion continued here, some work started at some othe= r=20 >> place. Now... in case someone here is willing to help instead of talki= ng, feel=20 >> free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look = what can=20 >> be improved. The page is far from perfect and needs some additional pe= ople=20 >> which are willing to improve it. >>>>> >>>>> This is only part of the problem. A tuning page in the wiki - which= =20 >> could be referenced from the benchmark page - would be great too. Any = >> volunteers? A first step would be to take he tuning-man-page and wikif= y it.=20 >> Other tuning sources are welcome too. >>>>> >>>>> Every FreeBSD dev with a wiki account can hand out write access to = the=20 >> wiki. The benchmark page gives contributor-access. If someone wants wr= ite=20 >> access create a FirstnameLastname account and ask here for contributor= -access. >>>>> >>>>> Don't worry if you think your english is not good enough, even some= one- >> word notes can help (and _my_ english got already corrected by other p= eople on=20 >> the benchmark page). >>>>> >>>>> Bye, >>>>> Alexander. >>>>> >>>>> >>>>> >>>>> >>>> >>>> Nice to see movement ;-) >>>> >>>> But there seems something unclear: >>>> >>>> man make.conf(5) says, that MALLOC_PRODUCTION is a knob set in >>>> /etc/make.conf. >>>> The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. >>>> >>>> What's right and what's wrong now? >>> >>> I can say with certainty that this value belongs in /etc/make.conf >>> (on RELENG_8 and earlier at least). >>> >>> src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, >>> so, this is definitely a make.conf variable. >> >> Eh, normal make variables can go in src.conf as well. They do not hav= e >> to be listed in bsd.own.mk. World builds include /etc/src.conf wherea= s >> every make invocation includes /etc/make.conf via sys.mk. The only re= ason >> to use /etc/src.conf is to have a place to put variables only affect >> make buildworld / buildkernel but do not affect other make invocations= =2E >=20 > I was always under the impression src.conf(5) variables had to be > manually added to bsd.own.mk and similar bits (e.g. > src/tools/build/options/WITH_xxx which is what's used to create the > src.conf(5) man page), but upon your comment and manual investigation o= n > my part, I found you're indeed right. Taken from bsd.own.mk: >=20 > 107 .if !defined(_WITHOUT_SRCCONF) > 108 SRCCONF?=3D /etc/src.conf > 109 .if exists(${SRCCONF}) > 110 .include "${SRCCONF}" > 111 .endif > 112 .endif >=20 > As long as third-party software doesn't depend on MALLOC_PRODUCTION for= > something (I don't know why something would, but who knows; maybe > there's a third-party malloc implementation which might?), then putting= > it in src.conf would be fine (src/lib/libc/stdlib files reference it). >=20 Then the manpage should reflect this. man src.conf does not show up MALLOC_PRODUCTIOn, but man make.conf does. If the latter is right, then it should be worth mentioned that make.conf is incorporating src.conf. Just a suggestion. Regards, Oliver --------------enig1502F529B2C0204E19EA4E4D Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO9LnRAAoJEOgBcD7A/5N8jWkH/2vnf7syPz2Ody5yUBUIqBk8 6zLbCedWMEVT5Shv+Y9QI1Uc0ku5DieFK4kbFSkp5dpIwPz5FZyxq57bXvcB0lVs xGJJ+I6C9TySn58mGU46CR/qi2PWiX08aBtHerR6WOEKEhbeyw78Axf96KqhJmBG as04C9KmqFFrqRdLlMsttbj5FzJrJCbWXj0wTY1apFBbFYsxjNci7I1IOluIB5oM lcSX2Q1letuEHjf0snoMNW2CqszHxVuEOFEMPSCh09xLzuAMjv6a/4QN3ThqbaOZ MTf5G63H/LvlZRotYwalm+/LB21+8CYaYGlgwPXwLk+JlzRlbu1Ll6q9ElhIGI8= =UR3U -----END PGP SIGNATURE----- --------------enig1502F529B2C0204E19EA4E4D-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:30:12 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ADD1C106567A for ; Fri, 23 Dec 2011 17:30:12 +0000 (UTC) (envelope-from lattera@gmail.com) Received: from mail-tul01m020-f182.google.com (mail-tul01m020-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id F0E4E8FC15 for ; Fri, 23 Dec 2011 17:30:09 +0000 (UTC) Received: by obbwd18 with SMTP id wd18so7968641obb.13 for ; Fri, 23 Dec 2011 09:30:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=HO8ZIDJ6mTCp9qQnu+VXp/u19cyTgmpfBqpea+pEcqA=; b=ZSlZHMZ/XVgacfn1ImoQfQ2sAAh4HeMYUkzcTpeeGvLfNOxE9E9Z90QrYc39evDMv8 hiKxSI3uhG5a6ZRFtwY8eIgTS72Negzcy8ZRaAH6kE3N5E7wIX4i7Tm9Ef7n5ADh0cRX BSRTTREOvaGYUJ9eV1jscSsd+9HhILSL3e/oA= MIME-Version: 1.0 Received: by 10.182.76.134 with SMTP id k6mr5218713obw.10.1324661409359; Fri, 23 Dec 2011 09:30:09 -0800 (PST) Received: by 10.182.56.134 with HTTP; Fri, 23 Dec 2011 09:30:09 -0800 (PST) In-Reply-To: <4EF4B9A4.8060405@my.gd> References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> <4EF4B13E.2020109@my.gd> <4EF4B9A4.8060405@my.gd> Date: Fri, 23 Dec 2011 10:30:09 -0700 Message-ID: From: Shawn Webb To: Damien Fleuriot Content-Type: text/plain; charset=ISO-8859-1 Cc: Joe Holden , "freebsd-stable@freebsd.org" Subject: Re: Goo lists to subscribe to hear quickly about vulns ? ( was: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:30:12 -0000 I usually hear about them from other people. I also subscribe to the full-disclosure mailinglist. On Fri, Dec 23, 2011 at 10:25 AM, Damien Fleuriot wrote: > On topic, where do you guys subscribe to know of these vulns ahead of > their release on the ML ? > > I'm subscribed to the BIND ML but I don't recall seeing an advisory > there ahead of today. > > > On 12/23/11 6:03 PM, Shawn Webb wrote: >> Some people (like me) already knew about the vulnerabilities. And >> others are already exploiting some of these vulnerabilities. >> >> Thanks, >> >> Shawn Webb >> >> On Fri, Dec 23, 2011 at 9:50 AM, Damien Fleuriot wrote: >>> My point (which may or may not be valid) was that if the vulnerabilities >>> remained *undisclosed*, they would have a much lower chance of being >>> exploited. >>> >>> >>> >>> On 12/23/11 5:47 PM, Joe Holden wrote: >>>> So don't update until Monday? The outcome will be the same :) >>>> >>>> Damien Fleuriot wrote: >>>>> Hey up list, >>>>> >>>>> >>>>> >>>>> Look, just a rant here. >>>>> >>>>> >>>>> Who in *HELL* thought it would be a cool idea to release no less than >>>>> FOUR security advisories today ? >>>>> >>>>> I mean, couldn't this have waited and remained undisclosed until monday ? >>>>> >>>>> I for one do *NOT* relish the idea of updating 50+ boxes this evening >>>>> and tomorrow ! >>>>> >>>>> >>>>> Not to mention a whole lot of merchants and banks have toggled IT Freeze >>>>> a few weeks ago, to ensure xmas shopping doesn't get disturbed by >>>>> production changes. >>>>> >>>>> >>>>> Seriously, this is just irritating. >>>>> >>>>> >>>>> /flame >>>>> _______________________________________________ >>>>> freebsd-stable@freebsd.org mailing list >>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>>>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >>>> >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:31:02 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CED5E1065678 for ; Fri, 23 Dec 2011 17:31:02 +0000 (UTC) (envelope-from b.smeelen@ose.nl) Received: from mail.ose.nl (mail.ose.nl [212.178.134.164]) by mx1.freebsd.org (Postfix) with ESMTP id 67E038FC27 for ; Fri, 23 Dec 2011 17:31:02 +0000 (UTC) X-Footer: b3NlLm5s Received: from localhost ([127.0.0.1]) by mail.ose.nl for freebsd-stable@freebsd.org; Fri, 23 Dec 2011 18:30:59 +0100 From: "Bas Smeelen" To: freebsd-stable@freebsd.org In-Reply-To: Message-ID: <20111223173059.42c16b05@mail.ose.nl> Date: Fri, 23 Dec 2011 18:30:59 +0100 X-User-Agent: Mozilla/5.0 (Ubuntu; X11; Linux i686; rv:8.0) Gecko/20100101 Firefox/8.0 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:31:02 -0000 > These vulnerabilities are known many days before in other distributions . >Thank you very much . >Mehmet Erol Sanliturk you're right, these were discussed on the mailinglists also _but_ FreeBSD is not a distribution It is *a complete operating system* Happy holidays Disclaimer: http://www.ose.nl/email From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:35:47 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61FBB1065729 for ; Fri, 23 Dec 2011 17:35:47 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id CA5648FC12 for ; Fri, 23 Dec 2011 17:35:46 +0000 (UTC) Received: by ggnp1 with SMTP id p1so10205402ggn.13 for ; Fri, 23 Dec 2011 09:35:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=2SJU7TV1dTRRm5CTDFb18fOdvt3aWeeFAF9zByeDd+o=; b=igj42qirgOAHXQpD59ND14TTZD33M7iCPwKK8uRsLbib9t9NyGx8eR7SggccYSkju/ qfS3tbL/1o5SVK36rVRYrPfiiAl72kQTH4nlFrpCj8OHYB13TAvMRFdFpo5HGEd2OP/d 40TkYum8KduCFyJ2rZNX9K9qe55gEUwsLscIE= MIME-Version: 1.0 Received: by 10.50.160.201 with SMTP id xm9mr14753153igb.16.1324661746218; Fri, 23 Dec 2011 09:35:46 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 09:35:46 -0800 (PST) In-Reply-To: <4EF4B982.3070207@missouri.edu> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> Date: Fri, 23 Dec 2011 19:35:46 +0200 Message-ID: From: George Kontostanos To: FreeBSD Stable Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:35:47 -0000 On Fri, Dec 23, 2011 at 7:25 PM, Stephen Montgomery-Smith wrote: > On 12/23/2011 10:56 AM, Mike Tancsa wrote: > >> Also, the chroot issue has been public for some time along with sample >> exploits. Same with BIND which was fixed some time ago. =A0Judgment call= , >> and I think they made the right call at least from my perspective. > > > It is this chroot issue that bothers me. =A0From my reading of the ftpd m= an > page, if I have anonymous ftp to my server, it seems that I am using chro= ot > with ftpd, and there is no way to stop this happening. > > Am I correct, or have I missed something? =A0(I am hoping I missed someth= ing.) > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" To sum up this mess. Are all cvs mirror servers updated regarding this chan= ges ? Also, I see that FreeBSD 9.0-RELEASE is included. Has it been released ? Regards-- George Kontostanos Aicom telecoms ltd http://www.barebsd.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:37:34 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 39E26106566C for ; Fri, 23 Dec 2011 17:37:34 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 067B78FC19 for ; Fri, 23 Dec 2011 17:37:34 +0000 (UTC) Received: from toshi.auburn.protected-networks.net (toshi.auburn.protected-networks.net [202.12.127.84]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "Iain Butler", Issuer "RSA Class 2 Personal CA" (verified OK)) (Authenticated sender: imb@protected-networks.net) by sarah.protected-networks.net (Postfix) with ESMTPSA id D2116613D for ; Fri, 23 Dec 2011 12:37:32 -0500 (EST) DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:subject: references:in-reply-to:x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=c516UMOS+Ov9zTzxy4rEY74pvrNFbmLLVWUihoMRifjqZmBzP9yB5a19gZeDSKBk9 kwpM3465oAB81gDEXhVf8j2bUvoHO7iN8A/UIXko98GlnEa1u4usBn4JHp1KgTk Message-ID: <4EF4BC5A.2040600@protected-networks.net> Date: Fri, 23 Dec 2011 12:37:30 -0500 From: Michael Butler User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:8.0) Gecko/20111111 Thunderbird/8.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4EF4A75C.2040609@my.gd> <201112231139.26613.jhb@freebsd.org> <4EF4B214.2070106@denninger.net> In-Reply-To: <4EF4B214.2070106@denninger.net> X-Enigmail-Version: undefined OpenPGP: id=0442D492 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:37:34 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 12/23/11 11:53, Karl Denninger wrote: > I happen to APPLAUD the FreeBSD Security team for doing this. > > I WANT security fixes out as soon as reasonably possible. You're NOT > telling the bad guys anything they don't already know, but you ARE > making it possible for the good guys to raise shields. > > A "remote root" problem is about as bad as it gets. +1 Even if the timing is less than optimal, having the necessary information "out there" offers the opportunity for each organization to make an *informed choice* as to which vulnerabilities might be present in their deployments, which are of highest priority and what resourcing decision are appropriate in their specific context. The FreeBSD Security folk are not saying "you must do this today"; they *can't* make that call on our behalf - it is entirely an organizational decision based on our assessment(s) of our risk and exposure, imb -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk70vFkACgkQQv9rrgRC1JJ1YgCdELKoI5JH8FaIjrlHm/Fco3y1 3s8AoJHarM0WhuCf0edFUWQpfkFF4g+S =Z4M2 -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:38:36 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D5ABB1065675 for ; Fri, 23 Dec 2011 17:38:36 +0000 (UTC) (envelope-from b.smeelen@ose.nl) Received: from mail.ose.nl (mail.ose.nl [212.178.134.164]) by mx1.freebsd.org (Postfix) with ESMTP id 69AEF8FC27 for ; Fri, 23 Dec 2011 17:38:36 +0000 (UTC) X-Footer: b3NlLm5s Received: from localhost ([127.0.0.1]) by mail.ose.nl; Fri, 23 Dec 2011 18:38:35 +0100 From: "Bas Smeelen" To: "Damien Fleuriot" , "Shawn Webb" In-Reply-To: <4EF4B9A4.8060405@my.gd> Message-ID: <20111223173835.93b21aa4@mail.ose.nl> Date: Fri, 23 Dec 2011 18:38:35 +0100 X-User-Agent: Mozilla/5.0 (Ubuntu; X11; Linux i686; rv:8.0) Gecko/20100101 Firefox/8.0 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Re: Goo lists to subscribe to hear quickly about vulns ? ( was: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:38:36 -0000 On topic, where do you guys subscribe to know of these vulns ahead of their release on the ML ? security, stable and questions it has been discussed here and there Disclaimer: http://www.ose.nl/email From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:55:37 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FE02106564A for ; Fri, 23 Dec 2011 17:55:37 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id 51FE28FC0C for ; Fri, 23 Dec 2011 17:55:37 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id pBNHtYbb025228; Fri, 23 Dec 2011 12:55:34 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <4EF4C08A.3080609@sentex.net> Date: Fri, 23 Dec 2011 12:55:22 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Stephen Montgomery-Smith References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> In-Reply-To: <4EF4B982.3070207@missouri.edu> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.71 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:55:37 -0000 On 12/23/2011 12:25 PM, Stephen Montgomery-Smith wrote: > > It is this chroot issue that bothers me. From my reading of the ftpd > man page, if I have anonymous ftp to my server, it seems that I am using > chroot with ftpd, and there is no way to stop this happening. > > Am I correct, or have I missed something? (I am hoping I missed > something.) Depends what they can write to and upload. The thread starts here http://lists.freebsd.org/pipermail/freebsd-security/2011-November/006085.html that discusses it in more detail ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 17:57:24 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C7367106566B for ; Fri, 23 Dec 2011 17:57:24 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 2EF6C8FC15 for ; Fri, 23 Dec 2011 17:57:24 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [IPv6:2001:8b0:151:1:fa1e:dfff:feda:c0bb]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.5/8.14.5) with ESMTP id pBNHvGYU010240 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Fri, 23 Dec 2011 17:57:16 GMT (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: OpenDKIM Filter v2.4.1 smtp.infracaninophile.co.uk pBNHvGYU010240 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1324663036; bh=2wcSPbL+H8x5lMHEutu+LxMKUHwvBVcIVNiTu7h9XNI=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Cc; b=k05QAgCxTvOrX3i8zwcx1E8q7FDB+c3yjkidtOx0Zjtseb3eI7UpxMsS6qTKqq1tq l17/emLzH8eNB5AR+9+JUqcAPcCsFzr1velSSZfvyq/Sd9HKt8kkTLoiK7PzhJgGIK GOklkJ5lZ8CCSVXjgwnyNNLws45lGyhAO3LmdzqM= Message-ID: <4EF4C0F0.1050603@infracaninophile.co.uk> Date: Fri, 23 Dec 2011 17:57:04 +0000 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0) Gecko/20111220 Thunderbird/9.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4EF4A75C.2040609@my.gd> <4EF4B0B2.10709@rewt.org.uk> <4EF4B13E.2020109@my.gd> <4EF4B9A4.8060405@my.gd> In-Reply-To: <4EF4B9A4.8060405@my.gd> X-Enigmail-Version: 1.3.4 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8ADDAD06F5569356901D7E27" X-Virus-Scanned: clamav-milter 0.97.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=5.0 tests=ALL_TRUSTED, AWL, DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU autolearn=ham version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on lucid-nonsense.infracaninophile.co.uk Subject: Re: Goo lists to subscribe to hear quickly about vulns ? ( was: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 17:57:24 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8ADDAD06F5569356901D7E27 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 23/12/2011 17:25, Damien Fleuriot wrote: > I'm subscribed to the BIND ML but I don't recall seeing an advisory > there ahead of today. The BIND vulnerability was discussed on bind-users last month, and updates were pushed to the ports and RELENG_7 and RELENG_8 pretty much straight away. RELENG_9 was patched slightly later. ISC's advisory is here: https://www.isc.org/software/bind/advisories/cve-2011-4313 Was also discussed on freebsd-questions@... around the same timeframe. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enig8ADDAD06F5569356901D7E27 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk70wPsACgkQ8Mjk52CukIxA+gCePwOLXQuQ/jftn1bay2XTEH7Q Lt8AoIsMN05xyku55aZSLRie6gfIYQvR =VrsQ -----END PGP SIGNATURE----- --------------enig8ADDAD06F5569356901D7E27-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 18:05:05 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 55351106566C for ; Fri, 23 Dec 2011 18:05:05 +0000 (UTC) (envelope-from guy.helmer@palisadesystems.com) Received: from ps-1-a.compliancesafe.com (ps-1-a.compliancesafe.com [216.81.161.161]) by mx1.freebsd.org (Postfix) with ESMTP id 93BFF8FC0A for ; Fri, 23 Dec 2011 18:05:01 +0000 (UTC) Received: from mail.palisadesystems.com (localhost [127.0.0.1]) by ps-1-a.compliancesafe.com (8.14.4/8.14.3) with ESMTP id pBNHkuDW052741; Fri, 23 Dec 2011 11:46:57 -0600 (CST) (envelope-from guy.helmer@palisadesystems.com) Received: from guysmbp.dyn.palisadesys.com (GuysMBP.dyn.palisadesys.com [172.16.2.90]) (authenticated bits=0) by mail.palisadesystems.com (8.14.3/8.14.3) with ESMTP id pBNHkeCv003512 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Fri, 23 Dec 2011 11:46:41 -0600 (CST) (envelope-from guy.helmer@palisadesystems.com) X-DKIM: Sendmail DKIM Filter v2.8.3 mail.palisadesystems.com pBNHkeCv003512 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=palisadesystems.com; s=mail; t=1324662401; bh=49RduJ04sqQJz9Pzl0sBE3ry6owh+9iPUTw/WLpzGTk=; l=128; h=Subject:Mime-Version:Content-Type:From:In-Reply-To:Date:Cc: Content-Transfer-Encoding:Message-Id:References:To; b=bGTD65WHX0tE+9J4pPdntQNxiBwG37Q5jVxUwYlb859DvB94w9VfSrOhHIqzUr/qx T7lZ1GiqDQdYzwmCP3MWboJbuUglTVjURqHNqMhieyQjMkyMRh9qQxoPW3Rrz6kpHE t2IVAMKhOxeFdSlaW697z5bdMJ9hbFZNoGl1myew= Mime-Version: 1.0 (Apple Message framework v1251.1) Content-Type: text/plain; charset=windows-1252 From: Guy Helmer In-Reply-To: <4EF4B982.3070207@missouri.edu> Date: Fri, 23 Dec 2011 11:46:40 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <4F78A870-0F09-4B0D-B238-02FD7C50CAF4@palisadesystems.com> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> To: Stephen Montgomery-Smith X-Mailer: Apple Mail (2.1251.1) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.5 (mail.palisadesystems.com [172.16.1.5]); Fri, 23 Dec 2011 11:46:41 -0600 (CST) X-Palisade-MailScanner-Information: Please contact the ISP for more information X-Palisade-MailScanner-ID: pBNHkeCv003512 X-Palisade-MailScanner: Found to be clean X-Palisade-MailScanner-SpamCheck: not spam (whitelisted), SpamAssassin (score=-1.628, required 5, ALL_TRUSTED -1.00, BAYES_00 -1.90, RP_8BIT 1.27) X-Palisade-MailScanner-From: guy.helmer@palisadesystems.com X-Spam-Status: No X-PacketSure-Scanned: Yes Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 18:05:05 -0000 On Dec 23, 2011, at 11:25 AM, Stephen Montgomery-Smith wrote: > On 12/23/2011 10:56 AM, Mike Tancsa wrote: >=20 >> Also, the chroot issue has been public for some time along with = sample >> exploits. Same with BIND which was fixed some time ago. Judgment = call, >> and I think they made the right call at least from my perspective. >=20 > It is this chroot issue that bothers me. =46rom my reading of the = ftpd man page, if I have anonymous ftp to my server, it seems that I am = using chroot with ftpd, and there is no way to stop this happening. >=20 > Am I correct, or have I missed something? (I am hoping I missed = something.) I think that to exploit the ftpd chroot issue, the attacker must have = the ability to create an /etc/nsswitch.conf (if it doesn't already = exist), and then requires installing a malicious shared library file in = the chroot /lib, /usr/lib, or /usr/local/lib directory. Local users who = have chroot configured on their home directory for FTP access could = probably exploit this. If your anonymous FTP directories are setup correctly, in particular so = that anonymous users have no write access, and if local users can't = corrupt that configuration (such as by changing owners or permissions of = directories in the anonymous chroot area), then I wouldn't expect this = to be exploitable. Still, I would install the update as soon as possible=85 Guy= -------- This message has been scanned by ComplianceSafe, powered by Palisade's PacketSure. From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 18:05:57 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D084D106566B for ; Fri, 23 Dec 2011 18:05:57 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id 7CABD8FC0C for ; Fri, 23 Dec 2011 18:05:57 +0000 (UTC) Received: by ggnp1 with SMTP id p1so10223642ggn.13 for ; Fri, 23 Dec 2011 10:05:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=CVJlh6eKTsyaIFpuR07d9V1STcCLCjO7ivlO2WpVV84=; b=YTTp2nFhnaaoGrcTypSLZ+AW2nYwDsSY8kxSxe9ghmVvbARc0w6bQtl/FTz4OBjp2o HZgKK3X0W8gUiDITGwr5LviauSF1vJiMrivKdSe3sX5miiIbg3wmyg85YUC/S/Nfh73p E7elSt2xZIab2Q9gfslcG8uKjJeZx/xETJFps= MIME-Version: 1.0 Received: by 10.50.187.226 with SMTP id fv2mr14838453igc.20.1324663556717; Fri, 23 Dec 2011 10:05:56 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 10:05:56 -0800 (PST) In-Reply-To: <4EF4C08A.3080609@sentex.net> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> Date: Fri, 23 Dec 2011 20:05:56 +0200 Message-ID: From: George Kontostanos To: FreeBSD Stable , FreeBSD Security Advisories Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 18:05:57 -0000 On Fri, Dec 23, 2011 at 7:55 PM, Mike Tancsa wrote: > On 12/23/2011 12:25 PM, Stephen Montgomery-Smith wrote: >> >> It is this chroot issue that bothers me. =A0From my reading of the ftpd >> man page, if I have anonymous ftp to my server, it seems that I am using >> chroot with ftpd, and there is no way to stop this happening. >> >> Am I correct, or have I missed something? =A0(I am hoping I missed >> something.) > > Depends what they can write to and upload. The thread starts here > > http://lists.freebsd.org/pipermail/freebsd-security/2011-November/006085.= html > > that discusses it in more detail > > =A0 =A0 =A0 =A0---Mike > > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada =A0 http://www.tancsa.com/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" Are all cvs mirror servers updated regarding these changes ? ANYBODY ???? --=20 George Kontostanos Aicom telecoms ltd http://www.barebsd.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 18:40:57 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 989AE106566B for ; Fri, 23 Dec 2011 18:40:57 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 008398FC16 for ; Fri, 23 Dec 2011 18:40:56 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [IPv6:2001:8b0:151:1:fa1e:dfff:feda:c0bb]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.5/8.14.5) with ESMTP id pBNIerP4040047 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Fri, 23 Dec 2011 18:40:53 GMT (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: OpenDKIM Filter v2.4.1 smtp.infracaninophile.co.uk pBNIerP4040047 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1324665653; bh=0sN+PBoPGaGKKs5kKT1F1ITtyuATRINHWSePVWc+rlg=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Cc; b=DmT9n/eJ5O96qOzv4rUhtGMUGZhTGC9AIoPema+TNVP8y2nmmlAadzLJgfcPvGjZJ s2NkRbfbfHgEKe8NsADTzdWpzIeUFnRfFGmh0NoX7s2QJUGhOIvsp/EQwBG4/NKKmA HdAcAJLmrSYXylsHZHIl/X4smpXwyBtI7kcOI/QY= Message-ID: <4EF4CB2E.4030109@infracaninophile.co.uk> Date: Fri, 23 Dec 2011 18:40:46 +0000 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0) Gecko/20111220 Thunderbird/9.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> In-Reply-To: X-Enigmail-Version: 1.3.4 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigC3EA5FD0648E4818B3615B4D" X-Virus-Scanned: clamav-milter 0.97.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=5.0 tests=ALL_TRUSTED, AWL, DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU autolearn=ham version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on lucid-nonsense.infracaninophile.co.uk Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 18:40:57 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigC3EA5FD0648E4818B3615B4D Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 23/12/2011 18:05, George Kontostanos wrote: > Are all cvs mirror servers updated regarding these changes ? >=20 > ANYBODY ???? Should have by now. Commits usually take about an hour to propagate to the official cvsup servers. Easy enough to tell though -- the advisories have all the version numbers in, and you'ld only need to check a file or two from each of them to be reasonably sure you'ld got all the updates. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enigC3EA5FD0648E4818B3615B4D Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk70yzUACgkQ8Mjk52CukIwmfwCfcQBCL4jqklSAfGwagV4DDHr9 Yy0AnRuLFCY9Pvgpn5AJFcP3YYbng/sD =QsIw -----END PGP SIGNATURE----- --------------enigC3EA5FD0648E4818B3615B4D-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 18:55:38 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5EC7C1065670 for ; Fri, 23 Dec 2011 18:55:38 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-tul01m020-f182.google.com (mail-tul01m020-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 21BA58FC12 for ; Fri, 23 Dec 2011 18:55:38 +0000 (UTC) Received: by obbwd18 with SMTP id wd18so8061680obb.13 for ; Fri, 23 Dec 2011 10:55:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=zx/BtX1y33OJUqamsb3sTVhZc/w6bNyLQeJ2LAaA3sM=; b=sUjVvzF40Pk1sm6ajbs0CsBdmq7eQvhLvmjvtlnjnvGu8gt43tqIU3Hhy+Tlrw+ZWD xSqHeW24zft2bFLJ9QeJ+8+yo0CicOX39mbwmZQACOBdthN9iy0mM6Ow9B4fK47jEwq0 tg48WrRsl4OJN2cryM2Wm6ur1ylypm4i9wkqc= MIME-Version: 1.0 Received: by 10.50.155.166 with SMTP id vx6mr15242285igb.16.1324666535715; Fri, 23 Dec 2011 10:55:35 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 10:55:35 -0800 (PST) In-Reply-To: <4EF4CB2E.4030109@infracaninophile.co.uk> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> Date: Fri, 23 Dec 2011 20:55:35 +0200 Message-ID: From: George Kontostanos To: FreeBSD Stable Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 18:55:38 -0000 On Fri, Dec 23, 2011 at 8:40 PM, Matthew Seaman wrote: > On 23/12/2011 18:05, George Kontostanos wrote: >> Are all cvs mirror servers updated regarding these changes ? >> >> ANYBODY ???? > > Should have by now. =A0Commits usually take about an hour to propagate to > the official cvsup servers. > > Easy enough to tell though -- the advisories have all the version > numbers in, and you'ld only need to check a file or two from each of > them to be reasonably sure you'ld got all the updates. > > =A0 =A0 =A0 =A0Cheers, > > =A0 =A0 =A0 =A0Matthew > > -- > Dr Matthew J Seaman MA, D.Phil. =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 7 Pri= ory Courtyard > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0Flat 3 > PGP: http://www.infracaninophile.co.uk/pgpkey =A0 =A0 Ramsgate > JID: matthew@infracaninophile.co.uk =A0 =A0 =A0 =A0 =A0 =A0 =A0 Kent, CT1= 1 9PW > Thanks for the info Matthew. I think though that it is best for all to first make sure that the servers all updated before sending out all those security advisories. Regards --=20 George Kontostanos Aicom telecoms ltd http://www.barebsd.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 18:57:41 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9266B106566B for ; Fri, 23 Dec 2011 18:57:41 +0000 (UTC) (envelope-from rloefgren@forethought.net) Received: from mzpi3.forethought.net (mzpi3.forethought.net [216.241.36.12]) by mx1.freebsd.org (Postfix) with ESMTP id 74F798FC0C for ; Fri, 23 Dec 2011 18:57:41 +0000 (UTC) Received: from wcpi6.forethought.net ([216.241.32.145] helo=localhost) by mz1.forethought.net with esmtp (Exim 4.69) (envelope-from ) id 1Re8tm-00061G-Mm; Fri, 23 Dec 2011 10:27:15 -0700 Received: from host1.medicenter.forethought.net (host1.medicenter.forethought.net [206.124.12.162]) by secure.forethought.net (IMP) with HTTP for ; Fri, 23 Dec 2011 10:27:14 -0700 Message-ID: <1324661234.4ef4b9f2937de@secure.forethought.net> Date: Fri, 23 Dec 2011 10:27:14 -0700 From: rloefgren@forethought.net To: Mike Tancsa References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> In-Reply-To: <4EF4B2D6.5090206@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit User-Agent: Internet Messaging Program (IMP) 3.2.2 X-Originating-IP: 206.124.12.162 Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 18:57:41 -0000 Quoting Mike Tancsa : > On 12/23/2011 11:07 AM, Damien Fleuriot wrote: > > Hey up list, > > Look, just a rant here. > > Who in *HELL* thought it would be a cool idea to release no less than > > FOUR security advisories today ? > > > The Security Officer explained it was because one of them was being > actively exploited. > > http://lists.freebsd.org/pipermail/freebsd-security-notifications/2011-December/000165.html > > > Also, the chroot issue has been public for some time along with sample > exploits. Same with BIND which was fixed some time ago. Judgment call, > and I think they made the right call at least from my perspective. > > ---Mike > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > To think a security threat could be rendered less serious based on the date of its announcement is rather provincial. You're damn right they made the right call. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program. From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 19:06:13 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4ADA31065686 for ; Fri, 23 Dec 2011 19:06:13 +0000 (UTC) (envelope-from lars@e-new.0x20.net) Received: from mail.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) by mx1.freebsd.org (Postfix) with ESMTP id CB9008FC16 for ; Fri, 23 Dec 2011 19:06:12 +0000 (UTC) Received: from mail.0x20.net (mail.0x20.net [217.69.76.211]) by mail.0x20.net (Postfix) with ESMTP id 6A9EC6A6619; Fri, 23 Dec 2011 20:06:11 +0100 (CET) X-Virus-Scanned: amavisd-new at mail.0x20.net Received: from mail.0x20.net ([217.69.76.211]) by mail.0x20.net (mail.0x20.net [217.69.76.211]) (amavisd-new, port 10024) with ESMTP id xr-VB3zjMV4C; Fri, 23 Dec 2011 20:06:11 +0100 (CET) Received: from e-new.0x20.net (mail.0x20.net [IPv6:2001:aa8:fffb:1::3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.0x20.net (Postfix) with ESMTPS id 2C0F56A61CB; Fri, 23 Dec 2011 20:06:11 +0100 (CET) Received: from e-new.0x20.net (localhost [127.0.0.1]) by e-new.0x20.net (8.14.4/8.14.4) with ESMTP id pBNJ6AxZ026892; Fri, 23 Dec 2011 20:06:10 +0100 (CET) (envelope-from lars@e-new.0x20.net) Received: (from lars@localhost) by e-new.0x20.net (8.14.4/8.14.4/Submit) id pBNJ6AAG025864; Fri, 23 Dec 2011 20:06:10 +0100 (CET) (envelope-from lars) Date: Fri, 23 Dec 2011 20:06:10 +0100 From: Lars Engels To: Bas Smeelen Message-ID: <20111223190610.GX13272@e-new.0x20.net> References: <20111223173059.42c16b05@mail.ose.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="5FFaGRZUwcpbKFrw" Content-Disposition: inline In-Reply-To: <20111223173059.42c16b05@mail.ose.nl> X-Editor: VIM - Vi IMproved 7.3 X-Operation-System: FreeBSD 8.2-RELEASE-p3 User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 19:06:13 -0000 --5FFaGRZUwcpbKFrw Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Dec 23, 2011 at 06:30:59PM +0100, Bas Smeelen wrote: > > These vulnerabilities are known many days before in other distributions= . >=20 > >Thank you very much . >=20 > >Mehmet Erol Sanliturk >=20 > you're right, these were discussed on the mailinglists also > _but_ FreeBSD is not a distribution > It is *a complete operating system* > Happy holidays And the D in BSD is for? ;-) --5FFaGRZUwcpbKFrw Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk700SIACgkQKc512sD3afhR4wCgyJf+kEQvCuVTZ438m7l2mNpB xSIAn1YkocO+h7xrAmszXi2/wJCoVVJY =5l2p -----END PGP SIGNATURE----- --5FFaGRZUwcpbKFrw-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 19:11:47 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 528A0106564A; Fri, 23 Dec 2011 19:11:47 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id 0C67E8FC12; Fri, 23 Dec 2011 19:11:47 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBNJBkq0056394; Fri, 23 Dec 2011 11:11:46 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBNJBkLt056393; Fri, 23 Dec 2011 11:11:46 -0800 (PST) (envelope-from sgk) Date: Fri, 23 Dec 2011 11:11:46 -0800 From: Steve Kargl To: Adrian Chadd Message-ID: <20111223191146.GA56232@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 19:11:47 -0000 On Thu, Dec 22, 2011 at 04:23:29PM -0800, Adrian Chadd wrote: > On 22 December 2011 11:47, Steve Kargl wrote: > > > There is the additional observation in one of my 2008 > > emails (URLs have been posted) that if you have N+1 > > cpu-bound jobs with, say, job0 and job1 ping-ponging > > on cpu0 (due to ULE's cpu-affinity feature) and if I > > kill job2 running on cpu1, then neither job0 nor job1 > > will migrate to cpu1. ?So, one now has N cpu-bound > > jobs running on N-1 cpus. > > .. and this sounds like a pretty serious regression. Have you ever > filed a PR for it? > Ah, so goods news! I cannot reproduce this problem that I saw 3+ years ago on the 4-cpu node, which is currently running a ULE kernel. When I killed the (N+1)th job, the N remaining jobs are spread across the N cpus. One difference between the 2008 tests and today tests is the number of available cpus. In 2008, I ran the tests on a node with 8 cpus, while today's test used only a node with only 4 cpus. If this behavior is a scaling issue, I can't currently test it. But, today's tests are certainly encouraging. -- Steve From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 19:15:28 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3AE70106566B for ; Fri, 23 Dec 2011 19:15:28 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 079168FC12 for ; Fri, 23 Dec 2011 19:15:27 +0000 (UTC) Received: by iadj38 with SMTP id j38so17730257iad.13 for ; Fri, 23 Dec 2011 11:15:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=bT8BjUxo9UuJXxIeT6RGPwBddB2c/GbKRuoX68dfCfI=; b=dj8YtV+DM7/gIbX+ixhaj0V3s4O6SwhMJgl0prq6n1iSeJ1MTmWODljLX2JiV4x5nS Yc2tJlqajFaSfaA6Foi52utwgTVQmjk0QInWYqNtJEtpaw5Fs3e+NAiShnNqIf9wpW58 2oK9lQWAzvc/CTRHkdQE2VfE6TNg3JkOd7iPY= MIME-Version: 1.0 Received: by 10.42.175.134 with SMTP id ba6mr15873130icb.23.1324667727355; Fri, 23 Dec 2011 11:15:27 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 11:15:27 -0800 (PST) In-Reply-To: <20111223190610.GX13272@e-new.0x20.net> References: <20111223173059.42c16b05@mail.ose.nl> <20111223190610.GX13272@e-new.0x20.net> Date: Fri, 23 Dec 2011 21:15:27 +0200 Message-ID: From: George Kontostanos To: Lars Engels Content-Type: text/plain; charset=ISO-8859-1 Cc: Bas Smeelen , freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 19:15:28 -0000 On Fri, Dec 23, 2011 at 9:06 PM, Lars Engels wrote: > On Fri, Dec 23, 2011 at 06:30:59PM +0100, Bas Smeelen wrote: >> > These vulnerabilities are known many days before in other distributions . >> >> >Thank you very much . >> >> >Mehmet Erol Sanliturk >> >> you're right, these were discussed on the mailinglists also >> _but_ FreeBSD is not a distribution >> It is *a complete operating system* >> Happy holidays > > And the D in BSD is for? ;-) So, are we done for today with the security advisories ? I hate to start rebuilding world & kernel again. -- George Kontostanos Aicom telecoms ltd http://www.barebsd.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 19:20:56 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4754B106566C for ; Fri, 23 Dec 2011 19:20:56 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-lpp01m010-f54.google.com (mail-lpp01m010-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id B7BAF8FC08 for ; Fri, 23 Dec 2011 19:20:55 +0000 (UTC) Received: by lahl5 with SMTP id l5so5395873lah.13 for ; Fri, 23 Dec 2011 11:20:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=ukzRMSY6xzM1TJRezJ92I5zhXdUImfee9/G7G5oswNU=; b=RGiHa3/Cg8BnL4sUARIT7tRThk3hV07zKNJX1z7AHa4C7RRfq7sVTK4JafGPx+A9MR FXiClnjOw2H+fkwuE5NjfFQsiKNNCUd+kv3xQskK+CQf7RlkAWD4EvMUQcFtBwdM92TZ KLZs2kWRcVJFyW/+/8zrLaQ3PloJxx1O2H1Fc= Received: by 10.152.103.51 with SMTP id ft19mr12853835lab.42.1324668054205; Fri, 23 Dec 2011 11:20:54 -0800 (PST) MIME-Version: 1.0 Received: by 10.152.129.8 with HTTP; Fri, 23 Dec 2011 11:20:23 -0800 (PST) In-Reply-To: <20111223190610.GX13272@e-new.0x20.net> References: <20111223173059.42c16b05@mail.ose.nl> <20111223190610.GX13272@e-new.0x20.net> From: Eitan Adler Date: Fri, 23 Dec 2011 14:20:23 -0500 Message-ID: To: Lars Engels Content-Type: text/plain; charset=UTF-8 Cc: Bas Smeelen , freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 19:20:56 -0000 On Fri, Dec 23, 2011 at 2:06 PM, Lars Engels wrote: > On Fri, Dec 23, 2011 at 06:30:59PM +0100, Bas Smeelen wrote: >> > These vulnerabilities are known many days before in other distributions . >> >> >Thank you very much . >> >> >Mehmet Erol Sanliturk >> >> you're right, these were discussed on the mailinglists also >> _but_ FreeBSD is not a distribution >> It is *a complete operating system* >> Happy holidays > > And the D in BSD is for? ;-) diethylamide ? -- Eitan Adler From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 19:29:08 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 00E4C106567B for ; Fri, 23 Dec 2011 19:29:08 +0000 (UTC) (envelope-from peterjeremy@acm.org) Received: from mail30.syd.optusnet.com.au (mail30.syd.optusnet.com.au [211.29.133.193]) by mx1.freebsd.org (Postfix) with ESMTP id 86E108FC14 for ; Fri, 23 Dec 2011 19:29:07 +0000 (UTC) Received: from server.vk2pj.dyndns.org (c220-239-116-103.belrs4.nsw.optusnet.com.au [220.239.116.103]) by mail30.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id pBNJSxJM032442 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 24 Dec 2011 06:29:01 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.5/8.14.4) with ESMTP id pBNJSwBt055461; Sat, 24 Dec 2011 06:28:58 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.5/8.14.4/Submit) id pBNJSv1f055372; Sat, 24 Dec 2011 06:28:57 +1100 (EST) (envelope-from peter) Date: Sat, 24 Dec 2011 06:28:57 +1100 From: Peter Jeremy To: Lars Engels Message-ID: <20111223192857.GA15456@server.vk2pj.dyndns.org> References: <20111223173059.42c16b05@mail.ose.nl> <20111223190610.GX13272@e-new.0x20.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="azLHFNyN32YCQGCU" Content-Disposition: inline In-Reply-To: <20111223190610.GX13272@e-new.0x20.net> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 19:29:08 -0000 --azLHFNyN32YCQGCU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2011-Dec-23 20:06:10 +0100, Lars Engels wrote: >On Fri, Dec 23, 2011 at 06:30:59PM +0100, Bas Smeelen wrote: >> _but_ FreeBSD is not a distribution >> It is *a complete operating system* >> Happy holidays > >And the D in BSD is for? ;-) FreeBSD is a complete operating system _derived_from_ the Berkeley Software Distribution that used to be available from the now-defunct UCB CSRG. The "BSD" in FreeBSD acknowledges its roots. And on-topic - yes, the timing sucks (especially since I'm one of the people reading this on the Saturday commencing a long holiday period) but I think the SO made the right call. Hopefully, this was all that was holding up 9.0-RELEASE and RE will be giving us a more welcome Xmas present. --=20 Peter Jeremy --azLHFNyN32YCQGCU Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk701nkACgkQ/opHv/APuIcxnQCePOj0PeBsMzSLBwhuh9JzQ7q1 01gAnRdfwkqE4lcxFrN7AdhTGQ3UTMU3 =Z0f3 -----END PGP SIGNATURE----- --azLHFNyN32YCQGCU-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 20:23:29 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1479C1065676; Fri, 23 Dec 2011 20:23:29 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-tul01m020-f182.google.com (mail-tul01m020-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id AFA358FC16; Fri, 23 Dec 2011 20:23:28 +0000 (UTC) Received: by obbwd18 with SMTP id wd18so8150718obb.13 for ; Fri, 23 Dec 2011 12:23:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Kf/ZXJWnVr9F2oe08cVEYJTbEa7jcwuO3NRfwYEot8k=; b=azgNLI9ss9WT4CGGhkjBlK9tCnMWtPX+DRCmM8/Mqf2K5P/+uUbIEKezatN0+uXQWR E8GXejMx6+PZQEsaSIG8Zeu5eyE580Xj82S3QRt0qCKV9dEsNIdnernQXeK0xMGuX94A Kem+wf6YwphwY0BfYl69DXcfkc2mjGv1PAOos= MIME-Version: 1.0 Received: by 10.182.225.66 with SMTP id ri2mr13927025obc.26.1324671808126; Fri, 23 Dec 2011 12:23:28 -0800 (PST) Received: by 10.182.62.227 with HTTP; Fri, 23 Dec 2011 12:23:27 -0800 (PST) In-Reply-To: <4EF45A1B.1050505@unsane.co.uk> References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> <9706CBFC-9A69-4365-8883-FF45BDFDC108@gmail.com> <4EF45A1B.1050505@unsane.co.uk> Date: Fri, 23 Dec 2011 12:23:27 -0800 Message-ID: From: Garrett Cooper To: Vincent Hoffman Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-stable@freebsd.org" , "freebsd-current@freebsd.org" , "igor@hybrid-lab.co.uk" , Alexander Leidinger , "freebsd-performance@freebsd.org" , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 20:23:29 -0000 On Fri, Dec 23, 2011 at 2:38 AM, Vincent Hoffman wrote= : > On 23/12/2011 02:56, Garrett Cooper wrote: >> On Dec 22, 2011, at 3:58 PM, Jeremy Chadwick = wrote: >> >>> On Fri, Dec 23, 2011 at 12:44:14AM +0100, O. Hartmann wrote: >>>> On 12/21/11 19:41, Alexander Leidinger wrote: >>>>> Hi, >>>>> >>>>> while the discussion continued here, some work started at some other = place. Now... in case someone here is willing to help instead of talking, f= eel free to go to http://wiki.freebsd.org/BenchmarkAdvice and have a look w= hat can be improved. The page is far from perfect and needs some additional= people which are willing to improve it. >>>>> >>>>> This is only part of the problem. A tuning page in the wiki - which c= ould be referenced from the benchmark page - would be great too. Any volunt= eers? A first step would be to take he tuning-man-page and wikify it. Other= tuning sources are welcome too. >>>>> >>>>> Every FreeBSD dev with a wiki account can hand out write access to th= e wiki. The benchmark page gives contributor-access. If someone wants write= access create a FirstnameLastname account and ask here for contributor-acc= ess. >>>>> >>>>> Don't worry if you think your english is not good enough, even some o= ne-word notes can help (and _my_ english got already corrected by other peo= ple on the benchmark page). >>>>> >>>>> Bye, >>>>> Alexander. >>>>> >>>>> >>>>> >>>>> >>>> Nice to see movement ;-) >>>> >>>> But there seems something unclear: >>>> >>>> man make.conf(5) says, that =A0MALLOC_PRODUCTION is a knob set in >>>> /etc/make.conf. >>>> The WiJi says, MALLOC_PRODUCTION is to be set in /etc/src.conf. >>>> >>>> What's right and what's wrong now? >>> I can say with certainty that this value belongs in /etc/make.conf >>> (on RELENG_8 and earlier at least). >>> >>> src/share/mk/bsd.own.mk has no framework for MK_MALLOC_PRODUCTION, >>> so, this is definitely a make.conf variable. >> Take the advice in tuning(7) with a grain of salt because a number of su= ggestions are really outdated. I know because I filed a PR last night after= I saw how out of synch some of the defaults it claimed were with reality o= n 9.x+. And I know other suggestions in the manpage are dated as well ;/. > There is a wiki page http://wiki.freebsd.org/SystemTuning which is > currently more or less tuning(7) with some annotations, the idea being > to sort out whats outdated/invalid with an aim of rewriting tuning(7) to > be more accurate and useful. I'll grab any info in your pr thats not up > there already to keep it updated if thats ok. Sure. Please take my suggestions (apart from the networking sysctls) with a grain of salt as I didn't look at the sourcecode for the filesystem ones (I was going off the top of my head and other emails I had seen passed around). I'll update the tuning 'wiki' with mention of the new networking defaults. If we want to make this manpage 'timeless', should we remove mention of defaults and go off basic guidelines (if you set this higher, you'll get better performance in scenario, X.Y.Z, etc)? Thanks! -Garrett From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 20:50:25 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7BA031065670 for ; Fri, 23 Dec 2011 20:50:25 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from noop.in-addr.com (mail.in-addr.com [IPv6:2001:470:8:162::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4A8AB8FC08 for ; Fri, 23 Dec 2011 20:50:25 +0000 (UTC) Received: from gjp by noop.in-addr.com with local (Exim 4.77 (FreeBSD)) (envelope-from ) id 1ReC2h-000C36-3w; Fri, 23 Dec 2011 15:48:39 -0500 Date: Fri, 23 Dec 2011 15:48:38 -0500 From: Gary Palmer To: George Kontostanos Message-ID: <20111223204838.GA43740@in-addr.com> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: gpalmer@freebsd.org X-SA-Exim-Scanned: No (on noop.in-addr.com); SAEximRunCond expanded to false Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 20:50:25 -0000 On Fri, Dec 23, 2011 at 08:55:35PM +0200, George Kontostanos wrote: > On Fri, Dec 23, 2011 at 8:40 PM, Matthew Seaman > wrote: > > On 23/12/2011 18:05, George Kontostanos wrote: > >> Are all cvs mirror servers updated regarding these changes ? > >> > >> ANYBODY ???? > > > > Should have by now. ?Commits usually take about an hour to propagate to > > the official cvsup servers. > > > > Easy enough to tell though -- the advisories have all the version > > numbers in, and you'ld only need to check a file or two from each of > > them to be reasonably sure you'ld got all the updates. > > > > ? ? ? ?Cheers, > > > > ? ? ? ?Matthew > > > > -- > > Dr Matthew J Seaman MA, D.Phil. ? ? ? ? ? ? ? ? ? 7 Priory Courtyard > > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?Flat 3 > > PGP: http://www.infracaninophile.co.uk/pgpkey ? ? Ramsgate > > JID: matthew@infracaninophile.co.uk ? ? ? ? ? ? ? Kent, CT11 9PW > > > > Thanks for the info Matthew. I think though that it is best for all to > first make sure that the servers all updated before sending out all > those security advisories. I don't believe they're monitored like that. If you want the updates quickly, download the files referenced in the advisories. My build was done before my local cvsup server picked up the changes. Gary From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 21:40:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5A634106566C for ; Fri, 23 Dec 2011 21:40:11 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 226768FC15 for ; Fri, 23 Dec 2011 21:40:10 +0000 (UTC) Received: by iadj38 with SMTP id j38so17948478iad.13 for ; Fri, 23 Dec 2011 13:40:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=Tm/wXaYlzYwph1WHAf6KmzIiGHDviX78XsS0bF5Tw0M=; b=JYQfCTphcPn8FleOPTvoO6DN+NjqDoDThR3yA4GwMrDeID+hW7orcu7SWuyw6BWosX WEBl4p45TbeNtBVYkQnS7e/GJuL8mOZwOTWWf5YwNGwbIQBjYyMGndfzWZLnsGG9qsEq W2Ii2nS9MDhVjKD2FqbOzuHaxQFzRUa7jx6Jo= MIME-Version: 1.0 Received: by 10.50.160.201 with SMTP id xm9mr15626681igb.16.1324676410409; Fri, 23 Dec 2011 13:40:10 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 13:40:10 -0800 (PST) In-Reply-To: <20111223204838.GA43740@in-addr.com> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> <20111223204838.GA43740@in-addr.com> Date: Fri, 23 Dec 2011 23:40:10 +0200 Message-ID: From: George Kontostanos To: Gary Palmer Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 21:40:11 -0000 On Fri, Dec 23, 2011 at 10:48 PM, Gary Palmer wrote: > On Fri, Dec 23, 2011 at 08:55:35PM +0200, George Kontostanos wrote: >> On Fri, Dec 23, 2011 at 8:40 PM, Matthew Seaman >> wrote: >> > On 23/12/2011 18:05, George Kontostanos wrote: >> >> Are all cvs mirror servers updated regarding these changes ? >> >> >> >> ANYBODY ???? >> > >> > Should have by now. ?Commits usually take about an hour to propagate t= o >> > the official cvsup servers. >> > >> > Easy enough to tell though -- the advisories have all the version >> > numbers in, and you'ld only need to check a file or two from each of >> > them to be reasonably sure you'ld got all the updates. >> > >> > ? ? ? ?Cheers, >> > >> > ? ? ? ?Matthew >> > >> > -- >> > Dr Matthew J Seaman MA, D.Phil. ? ? ? ? ? ? ? ? ? 7 Priory Courtyard >> > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?Flat 3 >> > PGP: http://www.infracaninophile.co.uk/pgpkey ? ? Ramsgate >> > JID: matthew@infracaninophile.co.uk ? ? ? ? ? ? ? Kent, CT11 9PW >> > >> >> Thanks for the info Matthew. I think though that it is best for all to >> first make sure that the servers all updated before sending out all >> those security advisories. > > I don't believe they're monitored like that. =A0If you want the updates > quickly, download the files referenced in the advisories. =A0My build was > done before my local cvsup server picked up the changes. > > Gary Yes, that's easy if you dealing with one server. But it is very different when you have to apply those patches to 20 different servers that are in different locations. Having a local cvsup server doing this job tends to make updating easier. In any case, and IMHO this was not the proper time for this kind of advisories considering the fact that many companies are in a freeze period. Cheers --=20 George Kontostanos From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 21:45:07 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B2EED106564A for ; Fri, 23 Dec 2011 21:45:07 +0000 (UTC) (envelope-from lattera@gmail.com) Received: from mail-tul01m020-f182.google.com (mail-tul01m020-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 711D88FC15 for ; Fri, 23 Dec 2011 21:45:07 +0000 (UTC) Received: by obbwd18 with SMTP id wd18so8219052obb.13 for ; Fri, 23 Dec 2011 13:45:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=8h6dpKWdqO5s8D4S921bLQiBXEBdYzjvV3Rc4bJqT60=; b=edI/TG9pFWD6yYovQ47EJYV8e7pQzvFpk9bVuNCRT3lkvGGLIXqbb0uG2/otdvXZAR 3zagy+Z99pDO3teuko+YJ/OyiE1vrh456EMNA1Oi1IPVHMqIGHD+Dqg4PVCnMJEj9z2o P00TtcQtEJdRrLwfkBc/7S+/IGw/i/U4vc/sU= MIME-Version: 1.0 Received: by 10.182.227.7 with SMTP id rw7mr14154799obc.70.1324676706700; Fri, 23 Dec 2011 13:45:06 -0800 (PST) Received: by 10.182.56.134 with HTTP; Fri, 23 Dec 2011 13:45:06 -0800 (PST) In-Reply-To: References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> <20111223204838.GA43740@in-addr.com> Date: Fri, 23 Dec 2011 14:45:06 -0700 Message-ID: From: Shawn Webb To: George Kontostanos Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 21:45:07 -0000 As others have mentioned, you don't _have_ to patch this weekend. All of the vulnerabilities have been [semi-]public knowledge for at least a week. What's the harm in waiting till next week? Just pretend like the patches came in on Tuesday. I, for one, am grateful that FreeBSD has provided patches. It allows people who do have the time/ability to patch this weekend to do just that. If you don't want to, then don't. Simple as that. Thanks, Shawn On Fri, Dec 23, 2011 at 2:40 PM, George Kontostanos wrote: > On Fri, Dec 23, 2011 at 10:48 PM, Gary Palmer wrote= : >> On Fri, Dec 23, 2011 at 08:55:35PM +0200, George Kontostanos wrote: >>> On Fri, Dec 23, 2011 at 8:40 PM, Matthew Seaman >>> wrote: >>> > On 23/12/2011 18:05, George Kontostanos wrote: >>> >> Are all cvs mirror servers updated regarding these changes ? >>> >> >>> >> ANYBODY ???? >>> > >>> > Should have by now. ?Commits usually take about an hour to propagate = to >>> > the official cvsup servers. >>> > >>> > Easy enough to tell though -- the advisories have all the version >>> > numbers in, and you'ld only need to check a file or two from each of >>> > them to be reasonably sure you'ld got all the updates. >>> > >>> > ? ? ? ?Cheers, >>> > >>> > ? ? ? ?Matthew >>> > >>> > -- >>> > Dr Matthew J Seaman MA, D.Phil. ? ? ? ? ? ? ? ? ? 7 Priory Courtyard >>> > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?Flat 3 >>> > PGP: http://www.infracaninophile.co.uk/pgpkey ? ? Ramsgate >>> > JID: matthew@infracaninophile.co.uk ? ? ? ? ? ? ? Kent, CT11 9PW >>> > >>> >>> Thanks for the info Matthew. I think though that it is best for all to >>> first make sure that the servers all updated before sending out all >>> those security advisories. >> >> I don't believe they're monitored like that. =A0If you want the updates >> quickly, download the files referenced in the advisories. =A0My build wa= s >> done before my local cvsup server picked up the changes. >> >> Gary > > Yes, that's easy if you dealing with one server. But it is very > different when you have to apply those patches to 20 different servers > that are in different locations. Having a local cvsup server doing > this job tends to make updating easier. > > In any case, and IMHO this was not the proper time for this kind of > advisories considering the fact that many companies are in a freeze > period. > > Cheers > > -- > George Kontostanos > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 21:57:13 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ED553106564A; Fri, 23 Dec 2011 21:57:13 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id A6FDC8FC0A; Fri, 23 Dec 2011 21:57:13 +0000 (UTC) Received: by iadj38 with SMTP id j38so17974972iad.13 for ; Fri, 23 Dec 2011 13:57:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=XhtHzezHnm9BECx3CGdFoUzocldIyc1pubhxq1veFW0=; b=YDGsOLyf557dqU/Ba6uuYVEHpdN0yfzv6b9jS/tNJH7U7xYtA9gXmxxoirqqWOFU0V 6U5guIBym4XxS/uI25dL/WsGYsIG3WZOBob6spq4Dr69gBKMgS+ovsMHb0LYc9V2FQxq cVFo9pedmvCFBbHjL42Sas0+V6g6F575n9Zu8= MIME-Version: 1.0 Received: by 10.50.155.166 with SMTP id vx6mr15843892igb.16.1324677432878; Fri, 23 Dec 2011 13:57:12 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 13:57:12 -0800 (PST) In-Reply-To: References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> <20111223204838.GA43740@in-addr.com> Date: Fri, 23 Dec 2011 23:57:12 +0200 Message-ID: From: George Kontostanos To: Shawn Webb Content-Type: text/plain; charset=ISO-8859-1 Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 21:57:14 -0000 On Fri, Dec 23, 2011 at 11:45 PM, Shawn Webb wrote: > As others have mentioned, you don't _have_ to patch this weekend. All > of the vulnerabilities have been [semi-]public knowledge for at least > a week. What's the harm in waiting till next week? Just pretend like > the patches came in on Tuesday. > > I, for one, am grateful that FreeBSD has provided patches. It allows > people who do have the time/ability to patch this weekend to do just > that. If you don't want to, then don't. Simple as that. > > Thanks, > > Shawn > I wish it was that simple. It is very different to be aware of a possible vulnerability from getting an official security advisory. Unfortunately sometimes, the decision to patch or not to patch, comes from people who decide based upon bureaucracy. I am certainly thankful to the FreeBSD security team for identifying and providing patches. However, when you start receiving emails about security advisories every 5 minutes, you tend to wonder when will they stop :) Regards and happy holidays George From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:02:22 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2E34E106566B for ; Fri, 23 Dec 2011 22:02:22 +0000 (UTC) (envelope-from peterjeremy@acm.org) Received: from mail15.syd.optusnet.com.au (mail15.syd.optusnet.com.au [211.29.132.196]) by mx1.freebsd.org (Postfix) with ESMTP id AF9178FC1B for ; Fri, 23 Dec 2011 22:02:21 +0000 (UTC) Received: from server.vk2pj.dyndns.org (c220-239-116-103.belrs4.nsw.optusnet.com.au [220.239.116.103]) by mail15.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id pBNM2JFQ007200 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 24 Dec 2011 09:02:20 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.5/8.14.4) with ESMTP id pBNM2IRd073290; Sat, 24 Dec 2011 09:02:18 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.5/8.14.4/Submit) id pBNM2IiZ073289; Sat, 24 Dec 2011 09:02:18 +1100 (EST) (envelope-from peter) Date: Sat, 24 Dec 2011 09:02:17 +1100 From: Peter Jeremy To: George Kontostanos Message-ID: <20111223220217.GB15456@server.vk2pj.dyndns.org> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> <20111223204838.GA43740@in-addr.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="QTprm0S8XgL7H0Dt" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:02:22 -0000 --QTprm0S8XgL7H0Dt Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2011-Dec-23 23:40:10 +0200, George Kontostanos = wrote: >In any case, and IMHO this was not the proper time for this kind of >advisories considering the fact that many companies are in a freeze >period. My honeypot logs suggest that the black hats aren't taking a holiday. As Colin posted, the SO had to decide between two unpalatable options and, IMHO, he made the correct decision. The details and fixes are now available - it's up to you to weigh up the risks of patching vs the risks of not patching. --=20 Peter Jeremy --QTprm0S8XgL7H0Dt Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk70+mkACgkQ/opHv/APuIfCXQCglgyeM/dpkLMO14cYHcxCEhaP JkMAn1ujyZSF0tZt/9NoCUW958NqgrR1 =yZNR -----END PGP SIGNATURE----- --QTprm0S8XgL7H0Dt-- From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:21:08 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B1DED106564A for ; Fri, 23 Dec 2011 22:21:08 +0000 (UTC) (envelope-from crmartin@sgi.com) Received: from relay.sgi.com (relay1.sgi.com [192.48.179.29]) by mx1.freebsd.org (Postfix) with ESMTP id 8BE4F8FC0C for ; Fri, 23 Dec 2011 22:21:08 +0000 (UTC) Received: from xmail.sgi.com (pv-excas1-dc21-nlb.corp.sgi.com [137.38.102.126]) by relay1.corp.sgi.com (Postfix) with ESMTP id E405A8F8084; Fri, 23 Dec 2011 14:21:07 -0800 (PST) Received: from [10.3.0.220] (10.3.0.220) by xmail.sgi.com (137.38.102.30) with Microsoft SMTP Server (TLS) id 14.1.339.1; Fri, 23 Dec 2011 16:21:07 -0600 Message-ID: <4EF4FED2.6020909@sgi.com> Date: Fri, 23 Dec 2011 15:21:06 -0700 From: Charlie Martin Organization: Silicon Graphics, Inc. User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111101 SUSE/3.1.16 Lightning/1.0b2 Thunderbird/3.1.16 MIME-Version: 1.0 To: References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> In-Reply-To: <20111223000705.GA6242@icarus.home.lan> Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.3.0.220] Cc: Eric Richards , Larry Fenske , crmartin@sgi.com, "Peter W. Morreale" , Jeremy Chadwick Subject: PRINTF_BUFR_SIZE=4096? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:21:08 -0000 In the course of looking at Jeremy's reponse to my query about a mystery panic, I noted his recommendation that PRINTF_BUFR_SIZE be set to 256. Ever-obedient, I went to set the value, and discovered instead that the conf file already has it set to 4096. As he says below, there are concerns about setting the value too high causing "major issues". I being Christmas and all I hate to ask Jeremy to dig up the post he mentioned, but wonder if anyone can clue me in on what the major issues might be? Thanks, and regards Charlie Martin On 12/22/2011 05:07 PM, Jeremy Chadwick wrote: > Also, be aware that the above stack trace is interspersed. Ultimately > you get to clean up the output yourself. This is a long-standing > problem with FreeBSD which can be helped but only slightly/barely by > using "options PRINTF_BUFR_SIZE=256" in your kernel configuration (the > default configs have a value of 128. Do not increase the value too > high, there are concerns about it causing major issues; I can dig up the > post that says that, but I'd rather not). -- Charles R. (Charlie) Martin Senior Software Engineer SGI logo 1900 Pike Road Longmont, CO 80501 Phone: 303-532-0209 E-Mail: CRMartin@sgi.com Website: www.sgi.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:31:18 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5CD82106566B for ; Fri, 23 Dec 2011 22:31:18 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id A33B88FC12 for ; Fri, 23 Dec 2011 22:31:17 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id AAA09991; Sat, 24 Dec 2011 00:31:10 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ReDdu-0003Rt-IM; Sat, 24 Dec 2011 00:31:10 +0200 Message-ID: <4EF5012D.2000804@FreeBSD.org> Date: Sat, 24 Dec 2011 00:31:09 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Charlie Martin References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> <4EF4FED2.6020909@sgi.com> In-Reply-To: <4EF4FED2.6020909@sgi.com> X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Eric Richards , Larry Fenske , freebsd-stable@FreeBSD.org, "Peter W. Morreale" , Jeremy Chadwick Subject: Re: PRINTF_BUFR_SIZE=4096? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:31:18 -0000 on 24/12/2011 00:21 Charlie Martin said the following: > In the course of looking at Jeremy's reponse to my query about a mystery panic, > I noted his recommendation that PRINTF_BUFR_SIZE be set to 256. Ever-obedient, > I went to set the value, and discovered instead that the conf file already has > it set to 4096. > > As he says below, there are concerns about setting the value too high causing > "major issues". > > I being Christmas and all I hate to ask Jeremy to dig up the post he mentioned, > but wonder if anyone can clue me in on what the major issues might be? Stack overflow. > Thanks, and regards > > Charlie Martin > > On 12/22/2011 05:07 PM, Jeremy Chadwick wrote: >> Also, be aware that the above stack trace is interspersed. Ultimately >> you get to clean up the output yourself. This is a long-standing >> problem with FreeBSD which can be helped but only slightly/barely by >> using "options PRINTF_BUFR_SIZE=256" in your kernel configuration (the >> default configs have a value of 128. Do not increase the value too >> high, there are concerns about it causing major issues; I can dig up the >> post that says that, but I'd rather not). > -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:34:53 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C5E3106566B for ; Fri, 23 Dec 2011 22:34:53 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 00BD98FC12 for ; Fri, 23 Dec 2011 22:34:52 +0000 (UTC) Received: by iadj38 with SMTP id j38so18035436iad.13 for ; Fri, 23 Dec 2011 14:34:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=+/teKwd9XXt902acIEyBApMAJcVTh+3jeRudpPPM8Q0=; b=u0F7NvJv093CiGcvMyiPVPMw2BOqt039W0nP4KPyDAN/svKL3YmfFo9wxtswpmhghY cUrJYGx3YKSDDxSctIstXg9RauXHl+yR2dDGH3autFshJTBzjBWbq+CkcgeLyGB6ETF3 pglVZ9KSrZJBk21rp2fzr7Xu3LSW0qFrB1+1c= MIME-Version: 1.0 Received: by 10.50.180.138 with SMTP id do10mr15724221igc.20.1324679692505; Fri, 23 Dec 2011 14:34:52 -0800 (PST) Received: by 10.231.15.7 with HTTP; Fri, 23 Dec 2011 14:34:52 -0800 (PST) In-Reply-To: <20111223220217.GB15456@server.vk2pj.dyndns.org> References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> <20111223204838.GA43740@in-addr.com> <20111223220217.GB15456@server.vk2pj.dyndns.org> Date: Sat, 24 Dec 2011 00:34:52 +0200 Message-ID: From: George Kontostanos To: Peter Jeremy Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:34:53 -0000 On Sat, Dec 24, 2011 at 12:02 AM, Peter Jeremy wrote: > On 2011-Dec-23 23:40:10 +0200, George Kontostanos wrote: >>In any case, and IMHO this was not the proper time for this kind of >>advisories considering the fact that many companies are in a freeze >>period. > > My honeypot logs suggest that the black hats aren't taking a holiday. > As Colin posted, the SO had to decide between two unpalatable options > and, IMHO, he made the correct decision. =A0The details and fixes are > now available - it's up to you to weigh up the risks of patching vs > the risks of not patching. > > -- > Peter Jeremy If a security advisory is announced, you have to patch, period! Happy holidays to all. Black hats too :) --=20 George From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:49:53 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 111151065675; Fri, 23 Dec 2011 22:49:53 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 993128FC08; Fri, 23 Dec 2011 22:49:52 +0000 (UTC) Received: by vbbfr13 with SMTP id fr13so13513880vbb.13 for ; Fri, 23 Dec 2011 14:49:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=9oXyzbLtwFQMWafaY9nzsUyuZgb7svjIANB7ro3UVMM=; b=TfnhI5k0VZDBffnYDCe3LntwMW7JjmjgsiXHf0LMLs7KDDbiX62ZMoZw/0fYuBPwXh Eq0EnSEgHnfZWtXDFG6aZSgv0BReokbpbs3lbhxLaFx9dkC1NoCKUHqM/kFux1x6rEip Uc4cW+6eOwoyCqm4GIivsD2Bn//yGWMiux/zw= MIME-Version: 1.0 Received: by 10.52.24.11 with SMTP id q11mr8418774vdf.83.1324680591853; Fri, 23 Dec 2011 14:49:51 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.36.5 with HTTP; Fri, 23 Dec 2011 14:49:51 -0800 (PST) In-Reply-To: <20111223191146.GA56232@troutmask.apl.washington.edu> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> Date: Fri, 23 Dec 2011 14:49:51 -0800 X-Google-Sender-Auth: bTRnXYrKlrFXzEPEgE_JZkeYZqs Message-ID: From: Adrian Chadd To: Steve Kargl Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:49:53 -0000 On 23 December 2011 11:11, Steve Kargl w= rote: > Ah, so goods news! =A0I cannot reproduce this problem that > I saw 3+ years ago on the 4-cpu node, which is currently > running a ULE kernel. =A0When I killed the (N+1)th job, > the N remaining jobs are spread across the N cpus. Ah, good. > One difference between the 2008 tests and today tests is > the number of available cpus. =A0In 2008, I ran the tests > on a node with 8 cpus, while today's test used only a > node with only 4 cpus. =A0If this behavior is a scaling > issue, I can't currently test it. =A0But, today's tests > are certainly encouraging. Do you not have access to anything with 8 CPUs in it? It'd be nice to get clarification that this indeed was fixed. Does ULE care (much) if the nodes are hyperthreading or real cores? Would that play a part in what it tries to schedule/spread? Adrian From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 22:54:47 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9BF88106566B for ; Fri, 23 Dec 2011 22:54:47 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta14.emeryville.ca.mail.comcast.net (qmta14.emeryville.ca.mail.comcast.net [76.96.27.212]) by mx1.freebsd.org (Postfix) with ESMTP id 80C1A8FC16 for ; Fri, 23 Dec 2011 22:54:47 +0000 (UTC) Received: from omta23.emeryville.ca.mail.comcast.net ([76.96.30.90]) by qmta14.emeryville.ca.mail.comcast.net with comcast id Cmkn1i0051wfjNsAEmugZy; Fri, 23 Dec 2011 22:54:40 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta23.emeryville.ca.mail.comcast.net with comcast id CmlY1i00L1t3BNj8jmlYg7; Fri, 23 Dec 2011 22:45:32 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id C04AB102C19; Fri, 23 Dec 2011 14:54:45 -0800 (PST) Date: Fri, 23 Dec 2011 14:54:45 -0800 From: Jeremy Chadwick To: Charlie Martin Message-ID: <20111223225445.GA29093@icarus.home.lan> References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> <4EF4FED2.6020909@sgi.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF4FED2.6020909@sgi.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Eric Richards , Larry Fenske , freebsd-stable@FreeBSD.org, "Peter W. Morreale" Subject: Re: PRINTF_BUFR_SIZE=4096? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 22:54:47 -0000 On Fri, Dec 23, 2011 at 03:21:06PM -0700, Charlie Martin wrote: > In the course of looking at Jeremy's reponse to my query about a > mystery panic, I noted his recommendation that PRINTF_BUFR_SIZE be > set to 256. Ever-obedient, I went to set the value, and discovered > instead that the conf file already has it set to 4096. > > As he says below, there are concerns about setting the value too > high causing "major issues". > > I being Christmas and all I hate to ask Jeremy to dig up the post he > mentioned, but wonder if anyone can clue me in on what the major > issues might be? As Andriy pointed out, potential stack overflow is the concern. The buffer size defined in the config file is allocated on the stack (e.g. char buf[4096]). The concern was mentioned by Kris Kenneway (and this is the post I eluded to): http://lists.freebsd.org/pipermail/freebsd-current/2008-February/083454.html When I was doing FreeBSD "stuff" as part of the Project, I added this to my Commonly Reported Issues wiki page since it comes up quite often. Search for "BUFR". http://wiki.freebsd.org/BugBusting/Commonly_reported_issues John Baldwin also chimed in with some insights a few years later: http://unix.derkeiler.com/Mailing-Lists/FreeBSD/current/2010-06/msg00545.html http://unix.derkeiler.com/Mailing-Lists/FreeBSD/current/2010-06/msg00632.html I had a conversation with John (I thought publicly but I can't find it; it's probably in my mail archives though) about this, as he has some ideas on how to solve it but he would need the time to work on it. I'll point out, however, that ddb(4) and dtrace debug (I think for debugging dtrace itself, not sure) kernel bits both use this same methodology (allocated buffer on the stack). See DDB_BUFR_SIZE and DTRACE_DEBUG_BUFR_SIZE. Linux solved this problem in a roundabout way, by implementing a "ring buffer" for klogd (kernel logging daemon). The below document looks daunting given its length and diagrams, but it's actually quite clever (well I thought so anyway): http://www.mjmwired.net/kernel/Documentation/trace/ring-buffer-design.txt Other info: http://www.makelinux.net/ldd3/chp-4-sect-2 > On 12/22/2011 05:07 PM, Jeremy Chadwick wrote: > >Also, be aware that the above stack trace is interspersed. Ultimately > >you get to clean up the output yourself. This is a long-standing > >problem with FreeBSD which can be helped but only slightly/barely by > >using "options PRINTF_BUFR_SIZE=256" in your kernel configuration (the > >default configs have a value of 128. Do not increase the value too > >high, there are concerns about it causing major issues; I can dig up the > >post that says that, but I'd rather not). -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 23:02:27 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B1E971065673 for ; Fri, 23 Dec 2011 23:02:27 +0000 (UTC) (envelope-from crmartin@sgi.com) Received: from relay.sgi.com (relay2.sgi.com [192.48.179.30]) by mx1.freebsd.org (Postfix) with ESMTP id 8B28A8FC0A for ; Fri, 23 Dec 2011 23:02:27 +0000 (UTC) Received: from xmail.sgi.com (pv-excas1-dc21-nlb.corp.sgi.com [137.38.102.126]) by relay2.corp.sgi.com (Postfix) with ESMTP id F2282304048; Fri, 23 Dec 2011 15:02:26 -0800 (PST) Received: from [10.3.0.220] (10.3.0.220) by xmail.sgi.com (137.38.102.30) with Microsoft SMTP Server (TLS) id 14.1.339.1; Fri, 23 Dec 2011 17:02:26 -0600 Message-ID: <4EF50882.9080609@sgi.com> Date: Fri, 23 Dec 2011 16:02:26 -0700 From: Charlie Martin Organization: Silicon Graphics, Inc. User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111101 SUSE/3.1.16 Lightning/1.0b2 Thunderbird/3.1.16 MIME-Version: 1.0 To: Jeremy Chadwick References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> <4EF4FED2.6020909@sgi.com> <20111223225445.GA29093@icarus.home.lan> In-Reply-To: <20111223225445.GA29093@icarus.home.lan> Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.3.0.220] Cc: Eric Richards , Larry Fenske , freebsd-stable@FreeBSD.org, "Peter W. Morreale" Subject: Re: PRINTF_BUFR_SIZE=4096? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 23:02:27 -0000 Thanks, Jeremy, I really was trying to keep you from needing to dig this out. This is inherited code with some very peculiar intermittent panics, so you can imagine that I would be interested in specifics of the odd behavior. Sadly, I don't think we're seeing any stack overflows. On 12/23/2011 03:54 PM, Jeremy Chadwick wrote: > On Fri, Dec 23, 2011 at 03:21:06PM -0700, Charlie Martin wrote: > When I was doing FreeBSD "stuff" as part of the Project, I added this to > my Commonly Reported Issues wiki page since it comes up quite often. > Search for "BUFR". > > http://wiki.freebsd.org/BugBusting/Commonly_reported_issues > I will note that all the "Commonly reported" page says is "set the value to 256" and point to three examples of people seeing garbled output. -- Charles R. (Charlie) Martin Senior Software Engineer SGI logo 1900 Pike Road Longmont, CO 80501 Phone: 303-532-0209 E-Mail: CRMartin@sgi.com Website: www.sgi.com From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 23:02:44 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12BD4106564A; Fri, 23 Dec 2011 23:02:44 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 23EBD8FC08; Fri, 23 Dec 2011 23:02:42 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id BAA10342; Sat, 24 Dec 2011 01:02:41 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1ReE8P-0003Ss-6o; Sat, 24 Dec 2011 01:02:41 +0200 Message-ID: <4EF50890.8030509@FreeBSD.org> Date: Sat, 24 Dec 2011 01:02:40 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:8.0) Gecko/20111206 Thunderbird/8.0 MIME-Version: 1.0 To: Adrian Chadd References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> In-Reply-To: X-Enigmail-Version: undefined Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@FreeBSD.org, Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 23:02:44 -0000 on 24/12/2011 00:49 Adrian Chadd said the following: > Does ULE care (much) if the nodes are hyperthreading or real cores? > Would that play a part in what it tries to schedule/spread? An answer to this part from the theory. ULE does care about physical topology of the (logical) CPUs. So, for example, four cores are not the same as two core with two hw threads from ULE's perspective. Still, ULE tries to eliminate any imbalances between the CPU groups starting from the top level (e.g. CPU packages in a multi-socket system) and all the way down to the individual (logical) CPUs. Thus, given enough load (L >= N) there should not be an idle CPU in the system whatever the topology. Modulo bugs, of course, as always. -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Fri Dec 23 23:24:44 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18D92106564A; Fri, 23 Dec 2011 23:24:44 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) by mx1.freebsd.org (Postfix) with ESMTP id C65068FC19; Fri, 23 Dec 2011 23:24:43 +0000 (UTC) Received: from troutmask.apl.washington.edu (localhost.apl.washington.edu [127.0.0.1]) by troutmask.apl.washington.edu (8.14.5/8.14.5) with ESMTP id pBNNOhW6064529; Fri, 23 Dec 2011 15:24:43 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.14.5/8.14.5/Submit) id pBNNOhrB064528; Fri, 23 Dec 2011 15:24:43 -0800 (PST) (envelope-from sgk) Date: Fri, 23 Dec 2011 15:24:43 -0800 From: Steve Kargl To: Adrian Chadd Message-ID: <20111223232443.GA64459@troutmask.apl.washington.edu> References: <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-stable@freebsd.org, Andriy Gapon Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2011 23:24:44 -0000 On Fri, Dec 23, 2011 at 02:49:51PM -0800, Adrian Chadd wrote: > On 23 December 2011 11:11, Steve Kargl wrote: > > > One difference between the 2008 tests and today tests is > > the number of available cpus. ?In 2008, I ran the tests > > on a node with 8 cpus, while today's test used only a > > node with only 4 cpus. ?If this behavior is a scaling > > issue, I can't currently test it. ?But, today's tests > > are certainly encouraging. > > Do you not have access to anything with 8 CPUs in it? It'd be nice to > get clarification that this indeed was fixed. I have a few nodes with 8 cpus, but those are running 4BSD kernels. I try to keep my kernel and world sync, and by extension the kernel/world on each node is in sync with all other nodes. So, while I took the 4 cpu node off-line and updated it, at the moment I can't take another node off-line unless I do an update across the entire cluster. The update is planned for next year. > Does ULE care (much) if the nodes are hyperthreading or real cores? > Would that play a part in what it tries to schedule/spread? I only have opteron processors in the cluster, if you're referring to Intel's hypertheading technology, I can't look into ULE's behavior with HTT. -- Steve From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 00:20:47 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B62921065673 for ; Sat, 24 Dec 2011 00:20:47 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA11.westchester.pa.mail.comcast.net (qmta11.westchester.pa.mail.comcast.net [76.96.59.211]) by mx1.freebsd.org (Postfix) with ESMTP id 607A08FC14 for ; Sat, 24 Dec 2011 00:20:46 +0000 (UTC) Received: from omta05.westchester.pa.mail.comcast.net ([76.96.62.43]) by QMTA11.westchester.pa.mail.comcast.net with comcast id CoKx1i0030vyq2s5BoLnjR; Sat, 24 Dec 2011 00:20:47 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta05.westchester.pa.mail.comcast.net with comcast id CoLm1i0041t3BNj3RoLmiX; Sat, 24 Dec 2011 00:20:47 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id C6B3E102C19; Fri, 23 Dec 2011 16:20:44 -0800 (PST) Date: Fri, 23 Dec 2011 16:20:44 -0800 From: Jeremy Chadwick To: Charlie Martin Message-ID: <20111224002044.GA30339@icarus.home.lan> References: <4EF3B790.5050509@sgi.com> <20111223000705.GA6242@icarus.home.lan> <4EF4FED2.6020909@sgi.com> <20111223225445.GA29093@icarus.home.lan> <4EF50882.9080609@sgi.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4EF50882.9080609@sgi.com> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Eric Richards , Larry Fenske , freebsd-stable@FreeBSD.org, "Peter W. Morreale" Subject: Re: PRINTF_BUFR_SIZE=4096? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 00:20:47 -0000 On Fri, Dec 23, 2011 at 04:02:26PM -0700, Charlie Martin wrote: > Thanks, Jeremy, I really was trying to keep you from needing to dig > this out. This is inherited code with some very peculiar > intermittent panics, so you can imagine that I would be interested > in specifics of the odd behavior. Sadly, I don't think we're seeing > any stack overflows. I say this politely, not condescendingly: your last statement indicates you don't quite understand the nature of what having a large-ish stack-based buffer could do to the kernel. This is not userland. I'm pretty sure the issues you're seeing (the devfs stuff) is fixed or improved in RELENG_8, but I say that without being able to point you to a specific commit. My reasoning is that there has been a *ton* of improvements in devfs in RELENG_8 onward, and these will almost certainly not be backported to RELENG_7. You are very, *very* adamant about stating "we cannot upgrade", and it is my opinion that as long as you don't upgrade, you're going to be "stuck" with these kind of bugs. Therefore, it would be worth your time to put forth efforts in testing RELENG_8 (not 8.2-RELEASE please; seriously, go with 8.2-STABLE (RELENG_8), just trust me on this) in a test environment and see how things go for you. I think you will be pleased with the results. You'll also get much more attentive/better support from the community/developers since RELENG_8 is supported, while RELENG_7 (especially -PRERELEASE) is losing more and more attention. It's Security EOL ends sometime early next year, and I hope you're aware of that fact as well. What I'm getting at here, without getting political: you need to start considering developing resources to help with upgrading. But for sake of example, we have a FreeBSD RELENG_6 box (6.4-STABLE) in our cluster that has actively been up for 385 days (went down a year ago because of co-lo maintenance I was doing on power conduits). If this machine suddenly panic'd, would I report the bug to -stable and so on? No. I would suck it up. > On 12/23/2011 03:54 PM, Jeremy Chadwick wrote: > >On Fri, Dec 23, 2011 at 03:21:06PM -0700, Charlie Martin wrote: > > >When I was doing FreeBSD "stuff" as part of the Project, I added this to > >my Commonly Reported Issues wiki page since it comes up quite often. > >Search for "BUFR". > > > >http://wiki.freebsd.org/BugBusting/Commonly_reported_issues > > > > I will note that all the "Commonly reported" page says is "set the > value to 256" and point to three examples of people seeing garbled > output. There's some history here for why that is.... kind of. I'll try to explain: For many years, PRINT_BUFR_SIZE was not defined in any of the default kernel configs. It was mentioned in /sys/conf/NOTES, but did not ship in GENERIC, etc.. Then after more and more people (since the FreeBSD 6.x days) began reporting interspersed kernel output, more and more developers started finding it annoying too (both the reports and the problem itself; let me tell you, it makes using ddb to debug a kernel crash in real-time), the option was added to the default kernels since it *does* improve things a little bit (better than nothing). The value 256 is something *I personally* chose, because 128 was simply not improving things "enough" on our systems. 256 made a bigger difference. The reason it still remains as 128 in the stock kernel configs is due to the issue I mentioned in my previous post, re: developers having justified concerns over the implications of increasing this value too high. I want readers of this thread to understand something: my previous paragraph should not elude to "the higher the value, the better off you are". I have not actually *looked* at the code to see how it works. I tend to trust folks who know more about the implications (especially in kernel space) of large static buffers, but even in userland I understand the difference and implications of doing char buf[65536]; rather than char *buf = calloc(1, 65536);. TL;DR -- Don't just go increasing this value to something gigantic in hopes that the larger value means you can solve the problem. It won't solve the problem entirely. For now, *knowing* about interspersed output is enough. I'll also point out that Solaris 10 (not sure about OpenIndiana) also has this problem (we see it at work on occasion), so FreeBSD isn't alone. P.S. -- No one on this list should *ever* feel obliged to "cut me some slack" because of holidays. For example, for the past 10 years I have worked on every single US holiday including Christmas. I consider them just like any other day. Maybe it's because I'm not married, don't have kids, don't have a tree, etc. instead preferring to stick with relying on nostalgia/old memories of childhood Christmases and stuff like that. That's just how I am. :-) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 00:59:39 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE6491065770 for ; Sat, 24 Dec 2011 00:59:39 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 262ED8FC08 for ; Sat, 24 Dec 2011 00:59:38 +0000 (UTC) Received: from vhoffman-macbooklocal.local ([10.10.10.20]) (authenticated bits=0) by unsane.co.uk (8.14.4/8.14.4) with ESMTP id pBO0xN07088483 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Sat, 24 Dec 2011 00:59:24 GMT (envelope-from vince@unsane.co.uk) Message-ID: <4EF523EB.7060905@unsane.co.uk> Date: Sat, 24 Dec 2011 00:59:23 +0000 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: Garrett Cooper References: <4EF3C0CE.5040802@zedat.fu-berlin.de> <20111222235846.GA6071@icarus.home.lan> <9706CBFC-9A69-4365-8883-FF45BDFDC108@gmail.com> <4EF45A1B.1050505@unsane.co.uk> In-Reply-To: X-Enigmail-Version: 1.3.4 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-stable@freebsd.org" , "freebsd-current@freebsd.org" , "igor@hybrid-lab.co.uk" , Alexander Leidinger , "freebsd-performance@freebsd.org" , "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 00:59:39 -0000 On 23/12/2011 20:23, Garrett Cooper wrote: > On Fri, Dec 23, 2011 at 2:38 AM, Vincent Hoffman wrote: >> On 23/12/2011 02:56, Garrett Cooper wrote: >> There is a wiki page http://wiki.freebsd.org/SystemTuning which is >> currently more or less tuning(7) with some annotations, the idea being >> to sort out whats outdated/invalid with an aim of rewriting tuning(7) to >> be more accurate and useful. I'll grab any info in your pr thats not up >> there already to keep it updated if thats ok. > Sure. Please take my suggestions (apart from the networking > sysctls) with a grain of salt as I didn't look at the sourcecode for > the filesystem ones (I was going off the top of my head and other > emails I had seen passed around). > I'll update the tuning 'wiki' with mention of the new networking > defaults. If we want to make this manpage 'timeless', should we remove > mention of defaults and go off basic guidelines (if you set this > higher, you'll get better performance in scenario, X.Y.Z, etc)? > Thanks! > -Garrett Good point, for tuning the defaults are probably not so important as they are likely to change at some point (as the current man page will attest) so maybe its less important to document them. Happy Christmas (or holiday of your choice ;) to you all and I hope everyone has a good new year. Vince > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 11:00:45 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9104106564A; Sat, 24 Dec 2011 11:00:45 +0000 (UTC) (envelope-from daniel@digsys.bg) Received: from smtp-sofia.digsys.bg (smtp-sofia.digsys.bg [193.68.3.230]) by mx1.freebsd.org (Postfix) with ESMTP id 45FBC8FC0A; Sat, 24 Dec 2011 11:00:44 +0000 (UTC) Received: from digsys226-136.pip.digsys.bg (digsys226-136.pip.digsys.bg [193.68.136.226]) (authenticated bits=0) by smtp-sofia.digsys.bg (8.14.4/8.14.4) with ESMTP id pBOB0Y77060989 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sat, 24 Dec 2011 13:00:40 +0200 (EET) (envelope-from daniel@digsys.bg) Mime-Version: 1.0 (Apple Message framework v1251.1) Content-Type: text/plain; charset=iso-8859-1 From: Daniel Kalchev In-Reply-To: Date: Sat, 24 Dec 2011 13:00:34 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <7C00F287-AE0B-4621-8428-E6A6E3BDA084@digsys.bg> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> To: Adrian Chadd X-Mailer: Apple Mail (2.1251.1) Cc: freebsd-stable@freebsd.org, Andriy Gapon , Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 11:00:45 -0000 On Dec 24, 2011, at 12:49 AM, Adrian Chadd wrote: > Do you not have access to anything with 8 CPUs in it? It'd be nice to > get clarification that this indeed was fixed. I offered to do tests on 4x8 core Opteron system (32 cores total), but = was discouraged that contention would be too much and results = meaningless -- yet, such systems will be more and more popular. > Does ULE care (much) if the nodes are hyperthreading or real cores? > Would that play a part in what it tries to schedule/spread? I could also run the tests on 2x4x2 cores Xeon, which uses hyper = threading, 8 real or 16 virtual cores in total. I can torture both systems (actually two pairs) for a week or two. But I = may not have enough time to prepare the core/setup so any advice is = greatly appreciated. Be more descriptive :) Daniel= From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 11:15:59 2011 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1D36D106566C for ; Sat, 24 Dec 2011 11:15:59 +0000 (UTC) (envelope-from se@freebsd.org) Received: from nm30.bullet.mail.sp2.yahoo.com (nm30.bullet.mail.sp2.yahoo.com [98.139.91.100]) by mx1.freebsd.org (Postfix) with SMTP id E15768FC14 for ; Sat, 24 Dec 2011 11:15:58 +0000 (UTC) Received: from [98.139.91.68] by nm30.bullet.mail.sp2.yahoo.com with NNFMP; 24 Dec 2011 11:15:58 -0000 Received: from [208.71.42.211] by tm8.bullet.mail.sp2.yahoo.com with NNFMP; 24 Dec 2011 11:15:58 -0000 Received: from [127.0.0.1] by smtp222.mail.gq1.yahoo.com with NNFMP; 24 Dec 2011 11:15:58 -0000 X-Yahoo-Newman-Id: 710493.53393.bm@smtp222.mail.gq1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: 3ISS6S0VM1kw.uLrWJntn9y.h3eZLyHU5s6J0gz6jJJiLAb jlClg6XNdqJNRp1IExCjpS4E33m6iHBrvAr76eH63ntJifcD2i_qkj.t_QNO tecq.0.5SLaFwR5nt0ZhBTMFHgVxpDuJhb3f_PUFpGaGXmR.KguOS.5fkhPK HHlVjqpNsN30YmQNnG5mJ2DY.xlM6.rRl.QdRPzzGmYCTIZNLvXq2Z1c5bkt 3gg0eXtymHvViPmxnKvufUjZVvk8EBw8Hvs9dLgy7rMlW0YNCnJCegfphJop 0PcFq1L5AKXUdHJUYeykSFgqHo7kgQxfLh3S5uE.wDtPFg8sstRmTYW7m5Rv 15qSeQVdop2cdCRPzVhzAxxII_80BwdqMz.qNMp4vrXb385Hudqo_2uAlpgJ weGRx2N9oR7sSEY0- X-Yahoo-SMTP: iDf2N9.swBDAhYEh7VHfpgq0lnq. Received: from [192.168.119.20] (se@81.173.141.239 with plain) by smtp222.mail.gq1.yahoo.com with SMTP; 24 Dec 2011 03:15:58 -0800 PST Message-ID: <4EF5B46D.5030901@freebsd.org> Date: Sat, 24 Dec 2011 12:15:57 +0100 From: Stefan Esser User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:9.0) Gecko/20111222 Thunderbird/9.0.1 MIME-Version: 1.0 To: Andriy Gapon References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> <4EF50890.8030509@FreeBSD.org> In-Reply-To: <4EF50890.8030509@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Adrian Chadd , freebsd-stable@FreeBSD.org, Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 11:15:59 -0000 Am 24.12.2011 00:02, schrieb Andriy Gapon: > on 24/12/2011 00:49 Adrian Chadd said the following: >> Does ULE care (much) if the nodes are hyperthreading or real cores? >> Would that play a part in what it tries to schedule/spread? > > An answer to this part from the theory. > ULE does care about physical topology of the (logical) CPUs. > So, for example, four cores are not the same as two core with two hw threads > from ULE's perspective. Still, ULE tries to eliminate any imbalances between > the CPU groups starting from the top level (e.g. CPU packages in a multi-socket > system) and all the way down to the individual (logical) CPUs. > Thus, given enough load (L >= N) there should not be an idle CPU in the system > whatever the topology. Modulo bugs, of course, as always. I tried to locate the old message, where somebody explained why the topology lead to a thread being selected for migration, re-assigned and then on another topology level was swapped back and ended on just the core it had already been running on. The analysis was quite detailed and it may well have been part of that discussion back in 2008 that Steve Kargl mentioned ... This problem could be fixed by adding a slight degree if randomness. But if IIRC, a deterministic solution might also be possible, which just takes care not to put a thread back on the core it previously had been running on, if it has been determined that the thread should be migrated to a different core, before. Sorry for not being able to point to the old message that contained the analysis of this problem. Regards, STefan From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 16:51:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A217106566B; Sat, 24 Dec 2011 16:51:11 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id C0B388FC12; Sat, 24 Dec 2011 16:51:10 +0000 (UTC) Received: by vcbfk1 with SMTP id fk1so13932226vcb.13 for ; Sat, 24 Dec 2011 08:51:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=O4kZTjvAzwzmDhK30T6Q1Op5vpESrycxUukTFD+f5ik=; b=saL1lntPAe4+vNiL4eg9aWnMZAprb5ccvR0qAtIeFg7rIFG2rGYm3aLpM8M0V8wdHQ eEr1caDW7ae+HGc8cfUoN+VnG52S0Mbwe4hFMmglaIGCT9BFKq2DX0eYzv0ri53zWCzL DWnwHTyvSfYus8cj5vZWwNDicSztLbNugYTds= MIME-Version: 1.0 Received: by 10.220.213.137 with SMTP id gw9mr11512501vcb.3.1324745470332; Sat, 24 Dec 2011 08:51:10 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.52.36.5 with HTTP; Sat, 24 Dec 2011 08:51:09 -0800 (PST) In-Reply-To: <7C00F287-AE0B-4621-8428-E6A6E3BDA084@digsys.bg> References: <4EE1EAFE.3070408@m5p.com> <20111215215554.GA87606@troutmask.apl.washington.edu> <20111222005250.GA23115@troutmask.apl.washington.edu> <20111222103145.GA42457@onelab2.iet.unipi.it> <20111222184531.GA36084@troutmask.apl.washington.edu> <4EF37E7B.4020505@FreeBSD.org> <20111222194740.GA36796@troutmask.apl.washington.edu> <20111223191146.GA56232@troutmask.apl.washington.edu> <7C00F287-AE0B-4621-8428-E6A6E3BDA084@digsys.bg> Date: Sat, 24 Dec 2011 08:51:09 -0800 X-Google-Sender-Auth: isqg-uQsttEjAlQvQaXym_OoGHU Message-ID: From: Adrian Chadd To: Daniel Kalchev Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-stable@freebsd.org, Andriy Gapon , Steve Kargl Subject: Re: SCHED_ULE should not be the default X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 16:51:11 -0000 My rule is "break it any way you can and see if you can figure out why." Don't be discouraged. You may find some of the folk at yahoo are interested. Adrian On 24 December 2011 03:00, Daniel Kalchev wrote: > > On Dec 24, 2011, at 12:49 AM, Adrian Chadd wrote: > >> Do you not have access to anything with 8 CPUs in it? It'd be nice to >> get clarification that this indeed was fixed. > > I offered to do tests on 4x8 core Opteron system (32 cores total), but was discouraged that contention would be too much and results meaningless -- yet, such systems will be more and more popular. > >> Does ULE care (much) if the nodes are hyperthreading or real cores? >> Would that play a part in what it tries to schedule/spread? > > I could also run the tests on 2x4x2 cores Xeon, which uses hyper threading, 8 real or 16 virtual cores in total. > > I can torture both systems (actually two pairs) for a week or two. But I may not have enough time to prepare the core/setup so any advice is greatly appreciated. Be more descriptive :) > > Daniel From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 17:05:54 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F017F106564A for ; Sat, 24 Dec 2011 17:05:54 +0000 (UTC) (envelope-from kurt.buff@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 83B098FC08 for ; Sat, 24 Dec 2011 17:05:54 +0000 (UTC) Received: by wgbdr11 with SMTP id dr11so18806796wgb.31 for ; Sat, 24 Dec 2011 09:05:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Tz+5/NCF346+crgydEoANNubBH07x02wK/r4k9XWtxQ=; b=D9sC0vYHKPQ1GxBB7JPakVE/mA4kKRemi6WLmK/yVlTV3L0usxaPd3MOkDayEPi4kW AEguxTZVPWOC+H5SsNs721mMvG4NTnXK43r+CQHZ44ha4XAerWENfD1F+v6dv/l6TjlV 03GVtoQJFGzEaHBJom9HgxgjHjmUEM6XgyPp0= MIME-Version: 1.0 Received: by 10.216.135.154 with SMTP id u26mr10289025wei.20.1324744575638; Sat, 24 Dec 2011 08:36:15 -0800 (PST) Received: by 10.216.80.99 with HTTP; Sat, 24 Dec 2011 08:36:15 -0800 (PST) In-Reply-To: <4EF4A75C.2040609@my.gd> References: <4EF4A75C.2040609@my.gd> Date: Sat, 24 Dec 2011 08:36:15 -0800 Message-ID: From: Kurt Buff To: "freebsd-stable@freebsd.org" Content-Type: text/plain; charset=UTF-8 Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 17:05:55 -0000 On Fri, Dec 23, 2011 at 08:07, Damien Fleuriot wrote: > Hey up list, > > Look, just a rant here. > > > Who in *HELL* thought it would be a cool idea to release no less than > FOUR security advisories today ? I'm guessing the Security Officer and those with whom he consults. Just a thought, since that's who sent the email. > I mean, couldn't this have waited and remained undisclosed until monday ? Does "active exploitation in the wild" mean anything to you? > I for one do *NOT* relish the idea of updating 50+ boxes this evening > and tomorrow ! Sucks to be you. You knew the job was dangerous when you took it, and if you didn't, well, then, bummer, it's what comes with the territory. I just spent my day yesterday downing my entire server environment in the US to upgrade the electrical, and it was a paid holiday for the company. As a sysadmin, you should know that these things happen, and learn to deal with them. > Not to mention a whole lot of merchants and banks have toggled IT Freeze > a few weeks ago, to ensure xmas shopping doesn't get disturbed by > production changes. Yeah. It's hell being a professional. > Seriously, this is just irritating. Cry me a river. You should be thanking the team for getting the releases to you as fast as possible, so you can take effective measures ASAP. Kurt From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 17:25:07 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 805D5106566B for ; Sat, 24 Dec 2011 17:25:07 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from qmta14.emeryville.ca.mail.comcast.net (qmta14.emeryville.ca.mail.comcast.net [76.96.27.212]) by mx1.freebsd.org (Postfix) with ESMTP id 609188FC12 for ; Sat, 24 Dec 2011 17:25:07 +0000 (UTC) Received: from omta01.emeryville.ca.mail.comcast.net ([76.96.30.11]) by qmta14.emeryville.ca.mail.comcast.net with comcast id D5Lg1i0020EPchoAE5R06c; Sat, 24 Dec 2011 17:25:00 +0000 Received: from koitsu.dyndns.org ([67.180.84.87]) by omta01.emeryville.ca.mail.comcast.net with comcast id D55w1i00x1t3BNj8M55x54; Sat, 24 Dec 2011 17:05:57 +0000 Received: by icarus.home.lan (Postfix, from userid 1000) id 085AC102C19; Sat, 24 Dec 2011 09:25:06 -0800 (PST) Date: Sat, 24 Dec 2011 09:25:06 -0800 From: Jeremy Chadwick To: Kurt Buff Message-ID: <20111224172505.GA48953@icarus.home.lan> References: <4EF4A75C.2040609@my.gd> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "freebsd-stable@freebsd.org" Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 17:25:07 -0000 On Sat, Dec 24, 2011 at 08:36:15AM -0800, Kurt Buff wrote: > On Fri, Dec 23, 2011 at 08:07, Damien Fleuriot wrote: > > Hey up list, > > > > Look, just a rant here. > > > > > > Who in *HELL* thought it would be a cool idea to release no less than > > FOUR security advisories today ? > > I'm guessing the Security Officer and those with whom he consults. > Just a thought, since that's who sent the email. > > > I mean, couldn't this have waited and remained undisclosed until monday ? > > Does "active exploitation in the wild" mean anything to you? > > > I for one do *NOT* relish the idea of updating 50+ boxes this evening > > and tomorrow ! > > Sucks to be you. You knew the job was dangerous when you took it, and > if you didn't, well, then, bummer, it's what comes with the territory. > > I just spent my day yesterday downing my entire server environment in > the US to upgrade the electrical, and it was a paid holiday for the > company. > > As a sysadmin, you should know that these things happen, and learn to > deal with them. > > > Not to mention a whole lot of merchants and banks have toggled IT Freeze > > a few weeks ago, to ensure xmas shopping doesn't get disturbed by > > production changes. > > Yeah. It's hell being a professional. > > > Seriously, this is just irritating. > > Cry me a river. You should be thanking the team for getting the > releases to you as fast as possible, so you can take effective > measures ASAP. While this is generally true, the BIND issue was absolutely not addressed "as fast as possible". I guess you weren't aware that it was announced publicly literally over a month ago: https://www.isc.org/software/bind/advisories/cve-2011-4313 I'm pretty certain there was a software update (new version of BIND) announced by ISC shortly after the discovery of this issue. I say this because we updated BIND at my workplace within 48-72 hours after said issue was announced. I say all of the above as politely and sincerely as possible -- I don't want the FreeBSD Security Team to feel like I'm slamming them for taking so long, as I'm quite aware there is sometimes red tape and unexpected complexities that take precedent. My point is that you're effectively telling Damien that he should be thankful for the quick resolution times, and that really isn't the case with regards to the BIND issue. As for the rest of your comments: I both agree and disagree with their sentiments. I would have summed it up as: "responsibility's a bitch". Try to remember: Damien admitted point blank, up front, that his Email was a rant. You know what they say about opinions, right? ;-) All in all, I do hope everyone here has a good holiday season, regardless if that's updating 50+ servers on Christmas Eve or at home with family. Try to take something positive out of either experience. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 21:28:52 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 92EC51065670 for ; Sat, 24 Dec 2011 21:28:52 +0000 (UTC) (envelope-from kurt.buff@gmail.com) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 232E38FC17 for ; Sat, 24 Dec 2011 21:28:51 +0000 (UTC) Received: by werb13 with SMTP id b13so8857251wer.13 for ; Sat, 24 Dec 2011 13:28:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=NQDfYvPcVB7gda0xmhfF8nBEPpUlxuexnyGRpDlmge0=; b=w+b2ABy3RYwHm7OdvibxUGPQ74qWNHzWUBir7hR3cl0mUSdUZQBwX4x3Jh179y+pFh q8xpcKbBgc6aKneDHiasmIxbRucm7tdDHBffI7S8y4F5kBXWdFiJf8VJ1MrVft/rehpK FNBWGgQZYvOhijBVFR0E/JtOsUocnsVVRAzaI= MIME-Version: 1.0 Received: by 10.216.131.72 with SMTP id l50mr16073813wei.28.1324762130125; Sat, 24 Dec 2011 13:28:50 -0800 (PST) Received: by 10.216.80.99 with HTTP; Sat, 24 Dec 2011 13:28:49 -0800 (PST) In-Reply-To: <20111224172505.GA48953@icarus.home.lan> References: <4EF4A75C.2040609@my.gd> <20111224172505.GA48953@icarus.home.lan> Date: Sat, 24 Dec 2011 13:28:49 -0800 Message-ID: From: Kurt Buff To: "freebsd-stable@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 21:28:52 -0000 On Sat, Dec 24, 2011 at 09:25, Jeremy Chadwick w= rote: > > While this is generally true, the BIND issue was absolutely not > addressed "as fast as possible". =C2=A0I guess you weren't aware that it = was > announced publicly literally over a month ago: > > https://www.isc.org/software/bind/advisories/cve-2011-4313 > > I'm pretty certain there was a software update (new version of BIND) > announced by ISC shortly after the discovery of this issue. =C2=A0I say t= his > because we updated BIND at my workplace within 48-72 hours after said > issue was announced. > > I say all of the above as politely and sincerely as possible -- I don't > want the FreeBSD Security Team to feel like I'm slamming them for taking > so long, as I'm quite aware there is sometimes red tape and unexpected > complexities that take precedent. =C2=A0My point is that you're effective= ly > telling Damien that he should be thankful for the quick resolution > times, and that really isn't the case with regards to the BIND issue. > > As for the rest of your comments: I both agree and disagree with their > sentiments. =C2=A0I would have summed it up as: "responsibility's a bitch= ". > Try to remember: Damien admitted point blank, up front, that his Email > was a rant. =C2=A0You know what they say about opinions, right? =C2=A0;-) > > All in all, I do hope everyone here has a good holiday season, > regardless if that's updating 50+ servers on Christmas Eve or at home > with family. =C2=A0Try to take something positive out of either experienc= e. I was aware, and followed along with, the discussion of the DNS problem on this and other lists. To me, "as fast as possible" does include overcoming the obstacles lie in wait beyond the brute coding. I also know that those who are more skilled or adventurous and otherwise more fortunate could have grabbed code and done it for themselves, but in many cases it's not possible. I'm betting the Colin, et al, were sweating over these releases, and really didn't want to do these releases quite so hard up against the holidays, but I'm glad they released them as soon as they felt it was the reasonable thing to do. I'm just afraid I don't have a lot of time for "woe is me" when the security of machines (and by extension of organizations) is at stake. Kurt From owner-freebsd-stable@FreeBSD.ORG Sat Dec 24 22:11:59 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 98169106564A for ; Sat, 24 Dec 2011 22:11:59 +0000 (UTC) (envelope-from utisoft@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 5D6578FC0C for ; Sat, 24 Dec 2011 22:11:58 +0000 (UTC) Received: by iadj38 with SMTP id j38so19825458iad.13 for ; Sat, 24 Dec 2011 14:11:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=kgMJQEpDdpr0zKt+UN/kx7PUryYLTwb1akFzpMN4n+Q=; b=cexsoSIzu10uVde7lN+/Tt0fjDQr4ZJIcnzD+GHdVl8ARU5BzifBAAJxBJFkob6t23 +KDe1v5WEO24pIQVwB4jSVA7HXmRm4xbYVo1OaKiQGOd+J0crlba1sQ/VrmQuzf6WopL O50oM8bA/cEClmONX2KG5UnflUyl6BoAs/QPs= MIME-Version: 1.0 Received: by 10.43.51.69 with SMTP id vh5mr22708146icb.32.1324764718552; Sat, 24 Dec 2011 14:11:58 -0800 (PST) Received: by 10.231.30.70 with HTTP; Sat, 24 Dec 2011 14:11:56 -0800 (PST) Received: by 10.231.30.70 with HTTP; Sat, 24 Dec 2011 14:11:56 -0800 (PST) In-Reply-To: References: <4EF4A75C.2040609@my.gd> <4EF4B2D6.5090206@sentex.net> <4EF4B982.3070207@missouri.edu> <4EF4C08A.3080609@sentex.net> <4EF4CB2E.4030109@infracaninophile.co.uk> Date: Sat, 24 Dec 2011 22:11:56 +0000 Message-ID: From: Chris Rees To: George Kontostanos Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: FreeBSD Stable Subject: Re: FLAME - security advisories on the 23rd ? uncool idea is uncool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Dec 2011 22:11:59 -0000 On 23 Dec 2011 18:56, "George Kontostanos" wrote: > > On Fri, Dec 23, 2011 at 8:40 PM, Matthew Seaman > wrote: > > On 23/12/2011 18:05, George Kontostanos wrote: > >> Are all cvs mirror servers updated regarding these changes ? > >> > >> ANYBODY ???? > > > > Should have by now. Commits usually take about an hour to propagate to > > the official cvsup servers. > > > > Easy enough to tell though -- the advisories have all the version > > numbers in, and you'ld only need to check a file or two from each of > > them to be reasonably sure you'ld got all the updates. > > > > Cheers, > > > > Matthew > > > > -- > > Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard > > Flat 3 > > PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate > > JID: matthew@infracaninophile.co.uk Kent, CT11 9PW > > > > Thanks for the info Matthew. I think though that it is best for all to > first make sure that the servers all updated before sending out all > those security advisories. > The emails contain patches. Chris