Date: Fri, 23 Jan 2015 07:29:13 +0000 From: Matthew Seaman <m.seaman@infracaninophile.co.uk> To: freebsd-ports@freebsd.org Subject: Re: Poudriere Timeout Message-ID: <54C1F849.7050101@infracaninophile.co.uk> In-Reply-To: <201501230234.t0N2YZbf033345@slippy.cwsent.com> References: <201501230234.t0N2YZbf033345@slippy.cwsent.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --48cgHMJ3HUGqPJURUoGtHeFOXN6HWUA5U Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 23/01/2015 02:34, Cy Schubert wrote: > In message <54C18193.1000701@FreeBSD.org>, Bryan Drewery writes: >> This is an OpenPGP/MIME signed message (RFC 4880 and 3156) >> --NvIRPgp2pVcRmjhwtM9TwAvH1900GK90a >> Content-Type: text/plain; charset=3Dwindows-1252 >> Content-Transfer-Encoding: quoted-printable >> >> On 1/18/2015 7:45 PM, Cy Schubert wrote: >>> Hi, >>> =3D20 >>> =3D20 >>> Has anyone seen this before?=3D20 >>> =3D20 >>> print/texlive-texmf texlive-texmf-20140525_4 package/timeout runaway_= pr=3D >> ocess >>> =3D20 >>> =3D20 >>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/= lo=3D >> cal/s >>> hare >>> /texmf-dist/doc/.keep_me >>> /bin/mkdir -p /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/l= oc=3D >> al/sh >>> are/ >>> texmf-dist/source >>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/= lo=3D >> cal/s >>> hare >>> /texmf-dist/source/.keep_me >>> =3D3D=3D3D=3D3D=3D3D> Compressing man pages (compress-man) >>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3= D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D >> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D= =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D >> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D= =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D >> =3D3D >>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3= D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D<p=3D >> hase: package >=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D= 3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D >> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D >>> =3D3D=3D3D=3D3D> Building package for texlive-texmf-20140525_4 >>> =3D3D=3D3D=3D3D=3D3D>> Killing timed out build after 3600 seconds >>> =3D3D=3D3D=3D3D=3D3D>> Cleaning up wrkdir >>> =3D3D=3D3D=3D3D> Cleaning for texlive-texmf-20140525_4 >>> build of print/texlive-texmf ended at Fri Jan 16 23:49:09 PST 2015 >>> build time: 02:41:43 >>> !!! build failure encountered !!! >>> =3D20 >>> Building the port by hand, make package, took just over 19 minutes (1= 15=3D >> 0=3D20 >>> seconds). Would increasing the timeout from 3600 to something larger = (l=3D >> ike=3D20 >>> 7200 -- I know this will require hacking the code) address the issue?= >>> =3D20 >>> =3D20 >> >> I'm curious why building outside of poudriere took 19 minutes, but >> inside took over 60 minutes. Did you have MFS or TMPFS enabled at the >> time of 60+ minutes? >=20 > No. I don't have enough memory to support mfs or tmpfs except for /tmp.= =20 > Having said that, my poudriere jails don't have tmpfs /tmp while all my= =20 > servers (and laptop) do. >=20 >> >> Is pkg the same version in the jail as your host? It may be a recent p= kg >> create regression. >=20 > All the software is the same. The difference is that the failed build w= as=20 > on an AMD 64 X2 4600+ (dual core with 5.5 GB) whereas the successful bu= ild=20 > was on an Intel Core I3 dual core with four threads with 6 GB. All=20 > filesystems are ZFS. >=20 > My guess is that the speed of the processors may have had something to = do=20 > with it. I don't think the extra 500 MB ram mattered much. All my build= =20 > systems are amd64 architecture. >=20 I've been seeing the same sort of problem with texlive-texmf. I only build a relatively small number of packages (1500) and I usually do a complete rebuild on Saturdays, and daily updates otherwise. I also enable package jobs everywhere as this does in general lead to faster compilation times despite the system load thrashing around at about 60-ish. This has the result that at the weekend, the single-threaded texlive-texmf 'pkg create' process is competing against many other processes for CPU time, and can overshoot the 3600 second timeout, hence resulting in the process being killed. During the week, generally there are only a few ports needing rebuild and texlive-texmf usually ends up as the only thing building, in which case it finishes just fine. I've a pretty simplistic work-around to this I intend to commit to pkg over the weekend: just add a counter to 'pkg create' so it puts out some output while processing the package's files. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. PGP: http://www.infracaninophile.co.uk/pgpkey JID: matthew@infracaninophile.co.uk --48cgHMJ3HUGqPJURUoGtHeFOXN6HWUA5U Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.20 (Darwin) iQJ8BAEBCgBmBQJUwfhYXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ2NTNBNjhCOTEzQTRFNkNGM0UxRTEzMjZC QjIzQUY1MThFMUE0MDEzAAoJELsjr1GOGkATP+wP/iFqPGzjVRF0ZxFfX8n3d6Dy ckDtQnPvb/RoG2F59mvmMuLArf852KEZNMbNnCnZ/9rp0vmlU0IeAYYyHw3diLG9 7QTJUcQB7wUsiOCwpAyRNqCiFrppEICbW1CpoEJ3/wZtYZJGDiE3RXY/SJCMy+GV lam21ShwMnfcm9wab6HR/kR7RBmSPTU9Ler5y6b8SO2tCLBXtHRyugrWFTmLE932 5tbqloysH+Rt9LLVuuxwxWRsgDtJkqdx8zWe/S0sz1ike5mEob4PUXC+3Ntb2Gx4 WiNhSONVr5D8TbmSXLNpOw3/oLcRoGakYYFr2VxCMIsGU0NVLOBMvVhyhvGC3kp7 gwOpaTkpFSB0fbhV23ZbS+wveM6VGcVwhmAYeX3PaJPXVTUfWDCfj9GaU43rNBSz gmPXlxO8a+MYawlUyJUnRDOmicbKeap04EqRrT6SmlhPooIb966We01rLRgVN4iY y6+e7CaygrTiddWLHHL04T8EW9PK0nvH6KZ01+uOFnCKJ+W+fgcqmvanK/k7hKT7 flj8Gm/1/wuCNTWxKxSHNphXQhcYTEDHlpNXzDoV5LJdWJGVcoSjOyob+xZsbxr/ uDftbQyk/tF3xr3c3lJ1fUFgQGRHTxj+XY8o34kqxKHRguE2PLv9aJDqE9kMUq6V k5NrVwjqZrGZMmbxo697 =3Cnv -----END PGP SIGNATURE----- --48cgHMJ3HUGqPJURUoGtHeFOXN6HWUA5U--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?54C1F849.7050101>