From owner-svn-src-head@freebsd.org Wed Jul 29 16:59:12 2015 Return-Path: Delivered-To: svn-src-head@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3B9D9ACBAB for ; Wed, 29 Jul 2015 16:59:12 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from mail-pd0-f178.google.com (mail-pd0-f178.google.com [209.85.192.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 828701042 for ; Wed, 29 Jul 2015 16:59:12 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: by pdbnt7 with SMTP id nt7so8956922pdb.0 for ; Wed, 29 Jul 2015 09:59:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:subject:mime-version:content-type:from :in-reply-to:date:cc:message-id:references:to; bh=adm2fAJHd63GVZk7VkfAzKrIne+FI4wPS9e9ymwj0vQ=; b=Fzgar6+q7FO3JFjxG8G9X3fOAvwz6JZVByMXGWXdvhmJTAt0J1DhfohWRTKWrr4nhj vdSGA5y7Q5NVKHmttHXZLaN+wkV05t0RcPKgftj6Yk/42jziWwvWDBCvISNNBbHQK01b A5GPX8I+j5J0bcdex61Y47Fs14Lmu7Jd0SWYGXAWta/s84ZHZ1iotIv6mazEFT074/02 TI48VylV9+c38+yBDeJGLudDJxEDI/W/VjjFroOYEAoggdJB/WKIXOo5ss5Hx0KSijq2 ILimCVRhB2DfsswskUIjgYHf9ozOHONxDQhUlNxAsPzTltzL17Hi44JOuJY1E+hWkvas YpXw== X-Gm-Message-State: ALoCoQkC2o5v+tB4qPLpQBWlPVbnCSr4z+n4kdDYebJdk+j67Z37WAQzs8bRYhvHkewAoyA7f+il X-Received: by 10.70.39.74 with SMTP id n10mr95458937pdk.57.1438189145953; Wed, 29 Jul 2015 09:59:05 -0700 (PDT) Received: from [10.64.26.97] ([69.53.236.236]) by smtp.gmail.com with ESMTPSA id j9sm36280560pdl.65.2015.07.29.09.59.03 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 29 Jul 2015 09:59:05 -0700 (PDT) Sender: Warner Losh Subject: Re: svn commit: r285068 - in head/sys: conf modules/agp modules/geom/geom_part/geom_part_apm modules/geom/geom_part/geom_part_bsd modules/geom/geom_part/geom_part_bsd64 modules/geom/geom_part/geom_part... Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\)) Content-Type: multipart/signed; boundary="Apple-Mail=_AC997849-22F2-4471-800E-1E8AC318E927"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.5 From: Warner Losh In-Reply-To: <55B8F547.2010008@selasky.org> Date: Wed, 29 Jul 2015 10:59:02 -0600 Cc: =?utf-8?Q?Roger_Pau_Monn=C3=A9?= , Adrian Chadd , Warner Losh , "src-committers@freebsd.org" , "svn-src-all@freebsd.org" , "svn-src-head@freebsd.org" , Shani Michaeli Message-Id: <2779441E-E53E-4DB4-84CF-36A0CFCB4C08@bsdimp.com> References: <201507030150.t631oRd0039490@repo.freebsd.org> <5596C188.10404@FreeBSD.org> <5596C7E7.5090700@FreeBSD.org> <68C8F69B-56DF-45C3-8DBB-40514CA48D85@bsdimp.com> <55B8A8CA.90701@selasky.org> <3414D44A-A22F-4693-9F84-A8E880C0B185@bsdimp.com> <55B8F547.2010008@selasky.org> To: Hans Petter Selasky X-Mailer: Apple Mail (2.2102) X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2015 16:59:12 -0000 --Apple-Mail=_AC997849-22F2-4471-800E-1E8AC318E927 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jul 29, 2015, at 9:46 AM, Hans Petter Selasky = wrote: >=20 > On 07/29/15 16:24, Warner Losh wrote: >>=20 >>> On Jul 29, 2015, at 4:19 AM, Hans Petter Selasky = wrote: >>>=20 >>> On 07/03/15 22:15, Warner Losh wrote: >>>>=20 >>>>> On Jul 3, 2015, at 11:35 AM, Roger Pau Monn=C3=A9 = wrote: >>>>>=20 >>>>> El 03/07/15 a les 19.26, Adrian Chadd ha escrit: >>>>>> ok, so why's it make NFS builds so slow? >>>>>=20 >>>>> AFAICT it makes the build process spawn a bunch of concurrent = "find" >>>>> processes that weren't previously there. >>>>=20 >>>> OK. I=E2=80=99ll fix it. I knew it might slow things down a little, = but this is quite a bit more than =E2=80=9Ca little=E2=80=9D. >>>>=20 >>>> Warner >>>>=20 >>>=20 >>> Hi, >>>=20 >>> Is there a fix for this issue yet? At Mellanox we're also seeing = that NFS mounted shares are extremely slow building even a single = module. Maybe the output from the find can be cached in a file somehow? >>=20 >> Committed the fix within a day of this message (so three weeks ago): >>=20 >> https://svnweb.freebsd.org/base?view=3Drevision&revision=3D285124 >>=20 >> Is it not working? this is the first negative report I=E2=80=99ve = heard since Adrian and Roger posted. I spiked the test-build with a find = that recorded every time it ran. W/o the fix, it runs a lot. With the = fix it ran once. Is this not the case still? >=20 > Hi, >=20 > In this particular case one "find of /sys" takes 11-16 seconds over = NFS, so building a single KMOD takes 16 seconds too. It's not possible = to eliminate the find entirely during repeated builds? 16 seconds? That=E2=80=99s a really slow NFS server and at least 11 = seconds longer than it should take :(. Make doesn=E2=80=99t really have the ability to cache results = run-to-run, but I=E2=80=99ll poke at other options. In the mean time, = you can do something like: setenv _MPATH `(cd $MAKEOBJDIRPREFIX/path/sys/GENERIC; make -V = _MPATH)` to cache the value. Not ideal, but likely good enough for repeated = module builds. If I can=E2=80=99t come up with anything clever, I=E2=80=99= ll just commit the current list=E2=80=A6 I hate doing that, but I also = hadn=E2=80=99t counted upon find taking so stinkin=E2=80=99 long... Warner --Apple-Mail=_AC997849-22F2-4471-800E-1E8AC318E927 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJVuQZXAAoJEGwc0Sh9sBEADogP/1XKaPQLCihfGhisydpSkBvv rSM3CZmAPEN5B3e3XhIXd52llEQCRGz6AYP1qsA8La0xozCE72RMmfIC3JRILRGU VjjcsNoj0P7zogCuPOv7ULfqYhTDLZijH/kEBaaUYYzbLKNxxr0bKjWVABSg8SvI v8CgEHOywMVpfJ3dKWnlCAPJ+d7OtSO66TWOOvfKfxtiP+Y3enVRYY/5adWM725g QO6Iiru2kxwXdQc7sEli0t/Y6IxnbIm7yH4bQ2eRVVoibQcG1MyOuOJ36PX3QHhe NW2kCrcEZibXE/S4Sob0zMd0uPLjjCuSnSli9pAhympTyll6pitGYR3UPG3uy0CJ P8F47kLmzMJF0FeDaWbmuCXf/4vaIOlK3CReFqvsj0Bx2tgIJaJnIAY221ac3gll F0fiislge597vd4JJZIfcRNYvWfa2bAvovNTPXM4LzzUTl/33ILaqB0R+jX+HwaA J3xNzjYPchYKIbiB45XldoIymdxOiBIc0TnEqiVv9aH0Prm7lH9i4cE8MjFJsNN1 oxBDhfBW8ncBzcXq7+OahNoIYpNpDmJuVuCZ+BkBVfhTulEnt8Xk9oCIp7qRPmFH xSSRSqAg3YubPZuWKjbV2pAnIx5QH9r8RALTCg3j9fCZZn7WGanYHYnhjSsqMo+p aJ/1aKGZnpHKgNVXSAXh =12Oc -----END PGP SIGNATURE----- --Apple-Mail=_AC997849-22F2-4471-800E-1E8AC318E927--