From owner-freebsd-arch@freebsd.org Fri Feb 26 23:20:21 2016 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 307FFAB57FE for ; Fri, 26 Feb 2016 23:20:21 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id F2BB11CA4 for ; Fri, 26 Feb 2016 23:20:20 +0000 (UTC) (envelope-from sjg@juniper.net) Received: by mailman.ysv.freebsd.org (Postfix) id EF245AB57FD; Fri, 26 Feb 2016 23:20:20 +0000 (UTC) Delivered-To: arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EEABEAB57FC for ; Fri, 26 Feb 2016 23:20:20 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from na01-bl2-obe.outbound.protection.outlook.com (mail-bl2on0126.outbound.protection.outlook.com [65.55.169.126]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 55A861CA3; Fri, 26 Feb 2016 23:20:19 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from BL2PR05CA0033.namprd05.prod.outlook.com (10.255.226.33) by CY1PR05MB1948.namprd05.prod.outlook.com (10.162.216.18) with Microsoft SMTP Server (TLS) id 15.1.409.15; Fri, 26 Feb 2016 23:20:12 +0000 Received: from BN1BFFO11OLC001.protection.gbl (2a01:111:f400:7c10::1:106) by BL2PR05CA0033.outlook.office365.com (2a01:111:e400:c04::33) with Microsoft SMTP Server (TLS) id 15.1.415.20 via Frontend Transport; Fri, 26 Feb 2016 23:20:12 +0000 Authentication-Results: spf=softfail (sender IP is 66.129.239.19) smtp.mailfrom=juniper.net; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.19 as permitted sender) Received: from p-emfe01b-sac.jnpr.net (66.129.239.19) by BN1BFFO11OLC001.mail.protection.outlook.com (10.58.145.12) with Microsoft SMTP Server (TLS) id 15.1.422.5 via Frontend Transport; Fri, 26 Feb 2016 23:20:12 +0000 Received: from magenta.juniper.net (172.17.27.123) by p-emfe01b-sac.jnpr.net (172.24.192.21) with Microsoft SMTP Server (TLS) id 14.3.123.3; Fri, 26 Feb 2016 15:20:10 -0800 Received: from kaos.jnpr.net (kaos.jnpr.net [172.21.16.84]) by magenta.juniper.net (8.11.3/8.11.3) with ESMTP id u1QNK8D62253; Fri, 26 Feb 2016 15:20:08 -0800 (PST) (envelope-from sjg@juniper.net) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 489F638551E; Fri, 26 Feb 2016 15:20:08 -0800 (PST) To: Bryan Drewery CC: , Subject: Re: Build -j target tags and command output In-Reply-To: <56D0CD68.606@FreeBSD.org> References: <56D0CD68.606@FreeBSD.org> Comments: In-reply-to: Bryan Drewery message dated "Fri, 26 Feb 2016 14:10:48 -0800." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6; nmh 1.6; GNU Emacs 24.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <77471.1456528808.1@kaos.jnpr.net> Content-Transfer-Encoding: quoted-printable Date: Fri, 26 Feb 2016 15:20:08 -0800 Message-ID: <77472.1456528808@kaos.jnpr.net> X-EOPAttributedMessage: 0 X-Microsoft-Exchange-Diagnostics: 1; BN1BFFO11OLC001; 1:E+M/LE8/4+RbOPhe2WFJfPi7h7VPtylHGS+0m84Nb17FqxKNx4V/npuWk3Yo2ytgawA8B758bKG3PekI1VSpz5pc5qEYPWgEmEC2FkWa7JywPerLa7XWDt3YjL5wDQIcGMd2m1yh8DV/f9Ts2S000PvbSAYLJWuiGeKQZY7Lp2To1cQvrjbBBpI2KR+xVQUaJvMkXIYbhKbxLl65a03oxOLSVaxW9z3Cf3gF6S+Es6QzBILQW50uFOWuApfIyiQNpn9mfL5UZxzvd/OQPGq+0oCPY4jnV4fFvfUEaLXfqrOsQ5EWt3VFr1aC3Xl8mJFrQAwgaOiZCEoUD7oOt3/Q58pDfBl1QHrfKO723ngUsjzwJgfEDdTLDcZig6qGqULd5f4YOS8+Q39i4StgQIrbkg== X-Forefront-Antispam-Report: CIP:66.129.239.19; CTRY:US; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(10019020)(6009001)(2980300002)(189002)(24454002)(199003)(377424004)(23726003)(50226001)(92566002)(50466002)(19580395003)(450100001)(97756001)(2810700001)(19580405001)(106466001)(2950100001)(77096005)(1096002)(46406003)(4326007)(76176999)(105596002)(6806005)(11100500001)(2906002)(5001960100002)(107886002)(110136002)(87936001)(50986999)(53416004)(76506005)(5003600100002)(117636001)(47776003)(189998001)(5008740100001)(4001430100002)(86362001)(586003)(1220700001)(42262002); DIR:OUT; SFP:1102; SCL:1; SRVR:CY1PR05MB1948; H:p-emfe01b-sac.jnpr.net; FPR:; SPF:SoftFail; MLV:sfv; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB1948; 2:whYZLoGbEDmV38ETob+1zQdaYB2xZLKLN6FkeerHT/BJj2WmpanYXg3YhaUpAgI0vF/bFQ51khOtR67c+J7ba5dblpq6hXgeeVL/LUb0DQKdVDJxwI8yIE5fk8FT/dHMvAhdQlvspEfe1d9/nKGqWA==; 3:zR0mQqEpmk/5NggVvS/6lqymMoAMhOF9MzpMIGZ15+4ufxzC+7hn3Kz0ZrRIj1+8STmCC6xmVBjvDDiIXfr2yIxvNzo7UqX2QPMszdeW4ICyZSekMSFON3VUO/bsa5gDoojL4v5YIJgW2GxA539H/WeB/Nr+2llM0F4Q+EUrEV06GVDEqjPD3bByogMHenWz0rMSL7TYGjFQcqrS2R6g2G9QS7BMaozOU+B2x2/dnec=; 25:rheOCvled7y/cE8bHDTCreWM5LbO54qJjdYkNlAPcG0dDWBT0KdHfIZo1XLt6UYt1uWY4WYniChdHZKfqFGRUHwofwKjScnctG25tiJ+a/ZT1dT+t+6RwGj7FwMOhSVdHmM/NbFyUW51eViihhBZN+zbHR726YNlBy0s75G4XXuErhfTq2gABy++8onWaAjsq0gTEB/LuIbLoFsgYpx65MLROFlw0eYGYbaTexR4NBF1bztsl0XgBFLuSgYwPQ7Qhjt4YjSgZrllju+RnxkIsdD0m4NpCxbEN3dS2zxN+xcQ+m6DLj7PfJYW5JTFyndeYK69VyxCGaDMRZmqfgCjwQ== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CY1PR05MB1948; X-MS-Office365-Filtering-Correlation-Id: 7a65b653-71da-44de-319a-08d33f036076 X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB1948; 20:pL71GoiY7x/OZkl66luKQK5H6vqpglrHLIzX39q3bD6TpEfpKM3fJYdJS8MmIuNYR/6DgtaH0aF9wIDn2LKgVBDy8ereoORLXHv5YeDVpszeITasHsGJFiuJ85uTgVvK01dVw0mZ3j924QR81UbxSXqMnYWCgz9qfdcX2wTUMfXc7D8onwUBgRvFJ4G7ecHsr6F2i1NBhdhUFD3XFS+piYACrrThlv2m+1nk7wcgPUBzGDnkByGXcfZmeL1JCrIB4DtbYFoDl1MyXQTdjfrkP7R7xdWzN+ukg/3zq6Zd3hsKnXn+8aYUxYBFhSqvj9ufrtaWjDGouAmoLyX/U/9UGY/v8Ja+ZxCtM9TAmvIxud4BYK5g1NVK7z2MPp3qPn/u7JGDsSMYbQhUKEnNmtvsBipOSn9EZvov+3+cwdT/KM5WqJJNjQGhFknxdeEl94xYRSUbmwjVazPaLlB77p4gAzSBz2yAUPW7eouwhOELph8Bw94JH8XqU4UMxbCDbYe1 X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(13024025)(13023025)(13018025)(5005006)(13015025)(13017025)(10201501046)(3002001); SRVR:CY1PR05MB1948; BCL:0; PCL:0; RULEID:; SRVR:CY1PR05MB1948; X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB1948; 4:wyK6DBz3ku/hclYr4tO0Gjk8g8/+NvlJk0+uoc6F9UGkF7pxXcw33rTvtUoLJqtfPvGWq82p16nQYXDpuRtEhe5zEM3dcEoKQB2KToafVnQ70nBi6sXi90oebsBF6g8gXdKrZ++xNLpywqn7G3bQBZj24gMNyZ1MzfwN8IU1K/TMEPMon/GMsZQRq2Q2vRosri9HAUo5Oy5Av9AakUpVefffBNZWTDHBintEzkKQj/gJFwT4x/YkqkaGK5Sh5bt+PmTVeH5zNrUPhUw098FVTOO6orUvfG+upKNza+SgRyrL7pepbP/QnOO76RNXbk1MpqeXK6BRJpnYDqhQgCWGvsxFoWk+SJqE+3Z1LTVFoGzPgVdi9CLb69OiwweVy6L18qO6VNWhhWi0Xvosu2XIm4lQdKUo0nllKpheze9PeMTmzlspzS1Lcir9KciLecXXOIAj12djNOB9cEwJa73A5w== X-Forefront-PRVS: 0864A36BBF X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; CY1PR05MB1948; 23:WeL+rgaESu9yyQdcY3dZ9zzrm32mWFqIJ6L8GZKK6?= =?us-ascii?Q?6UQ5cc2vxpyHOVWyjv6OdNEAw+dQyb/NYbBHSRLXk9tuSe8/P6HCB2HFx+18?= =?us-ascii?Q?BakpNCCBEAXeojTTYzn+i/IDqnDAONw6ZJWJ/GKmsZM89M/HIdPmB9tsmVRk?= =?us-ascii?Q?fvhtitN9iQ1zX6lkJnkUNv8RmI5tm8WvTig19pBIzgegTo5BM+PkGVESSYgS?= =?us-ascii?Q?Nxc0G/WUSCEiLbM9KJ5HJFoo6ffV/uiG2cQ5xUoqgxlWxEw/Rjt14LTkHLK1?= =?us-ascii?Q?+cdtweQ8O2VikgqPve2XJesmrVbVZEH5VaCUMORwFktxH67fsBR6ix/6DVJq?= =?us-ascii?Q?OWZ/W98B0nVeM+Lgq2GHXvEOkLu9ShD9OQsgu7IHG47W/5Pg6v2jE/SLoUsX?= =?us-ascii?Q?MW1ENb0LA1jsigb9XR2zOtFi7LmA7hAlJGDVlXM3XE6h4WvM2v8YfxwaPxMP?= =?us-ascii?Q?MiI7/3GJrjIfwE93mCg7cY+L4aDl5RGpDMB57qYfQpbJkTmxLkuHz9DwPnSj?= =?us-ascii?Q?G5QSD6QBG9rrfHnHhOF3UaNVM6vlqhpAhi8V3vMs2QacI/hvs8JF6sGfNbbN?= =?us-ascii?Q?nZv6VnRZsF3mRFKJa0PJgjmp96z4TtP5nTrA3gIj6ybNts/SbNyXEfqFmZ8C?= =?us-ascii?Q?vk1lYxmJrxUf2t2P3tFC8KsItx8YhBEBKkFtWb1f1lFpBEqfnwUkDWP23Of6?= =?us-ascii?Q?tbDRE844OxEluBUGV/FcVZlDCWVHjRzARGWo+jFJGjrnaKb5OXHaef/4N1Vk?= =?us-ascii?Q?cDgf+N7207Me/bIAwAKCXy7Y+W+e9J98XcaI4nma8HLxgMJ0nOofWyImR7dS?= =?us-ascii?Q?G2VnVY4/wtjAVnS+VJ64TTmZCDrO1Og3vZnYeqeX7TLtVsjMba0Qbfo1wosm?= =?us-ascii?Q?HToDytV+q1kyjOnAPv6kASFi0qlBoFN9nyxLZDV0SOG3apxboUOAQTQGmfSJ?= =?us-ascii?Q?vKS8pOA6/4NGzfFvz0czogak9qMx5jtHtDgKiZ4aZekQ74nJ4VXLU9rDJuh0?= =?us-ascii?Q?ZqxXzRtDbsqVtFguFdNVgj91ZZ+ihNG+6cwpwmjNDl8ZNOhysxfGuNXmLoAG?= =?us-ascii?Q?G88Up5TJYq0abuv9jf2iLZxVSuscWrvkpU7vWuzl/5Xe6ruG6/mJLUb48Jcv?= =?us-ascii?Q?tVErnr0F9ibPJeOrSlPmuavnJFbAmKY?= X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB1948; 5:A+VX42BA1pQyN7PAVAhxzmVsvLopQajg/0isjKbOubZf9nCpxsfzX4k+c7Jk2BuM1fjynQGLUgknVqhDEZ8GaATQYdl2HLLwbZi0Ey+b8YZWJsgQpDJM6/86M2C6eVVttTvLZb0ZnuoaxrxrgXZXNw==; 24:1knQSQLNR5jpcAMm1S1RNi2aHyGTmJxlKLC6OmhSc808KmIQzEDi2vUlsaZTCOIzYxMDEhCw+evCA4zQHpTwT61mhPIqA96i71gyG+GylvI= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Feb 2016 23:20:12.1438 (UTC) X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.239.19]; Helo=[p-emfe01b-sac.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR05MB1948 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Feb 2016 23:20:21 -0000 Bryan Drewery wrote: > I'm looking for opinions on whether we should keep or remove the -- Keep. Without them it is virtually impossible to identify which job produced certain output. Even with them, the log from a parallel hirerarchical build can get confusing - especially when multiple makes are writing at the same time. But you are still better off with some clues. > Removing them would yield potentially hard-to-debug failures since the Yes, pls don't do that. > failed command could be anywhere. At least the 'make stopped' error > that follows would print the directory. There is an interesting feature Yes, but generally the exciting stuff that caused the stoppage is earlier in the log. The --- lines allow use of scripts to demux the output. > in the meta mode build that will keep a log and print a more detailed > error message on failures so you really know which directory failed and > what environment it had, but it can be spammy as well since it prints > the same error information on the 'another make hit an error, dying' cas= es. Yes, the issue is largely moot with dirdeps/meta mode build. As your example clearly demonstrates. Not all targets produce a .meta file, and for these you may still get --- job lines, but they can hardly be considered an issue. All the gory details - that you need to debug issues saved in in the .meta file with no contamination from other jobs > Longterm, I think a merge between DIRDEPS_BUILD output and the NetBSD > build output makes sense and removes these --- lines entirely. It would With dirdeps build the noise that NetBSD outputs is just noise: Checking /tank/home/sjg/work/NetBSD/current/src/lib/csu for i386 ... Building /tank/home/sjg/work/NetBSD/current/obj/i386/lib/csu/gcrt0.o Building /tank/home/sjg/work/NetBSD/current/obj/i386/lib/csu/sysident_assy= m.h Building /tank/home/sjg/work/NetBSD/current/obj/i386/lib/csu/crtn.o --- gcrt0.o --- # compile csu/gcrt0.o --- sysident_assym.h --- # create csu/sysident_assym.h --- crtn.o --- # compile csu/crtn.o > DIRDEPS_BUILD output: > = > > ~/git/freebsd # WITH_DIRDEPS_BUILD=3Dyes make -C bin/sh -j15 > ... > > --- /root/git/freebsd/bin/sh.amd64,amd64 1334 --- > > @ 1456524548 [2016-02-26 14:09:08] Checking /root/git/freebsd/bin/sh f= or amd64,amd64 ... > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/.dirdep > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/builtins.c > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/mknodes.o > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/mksyntax.o > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/token.h > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/stage_incs > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/stage_symlinks.m= an1 > > Building /usr/obj/root/git/freebsd/amd64.amd64/bin/sh/stage_links.man1 > > Checking /root/git/freebsd/bin/sh/Makefile.depend: .dirdep.meta builti= ns.c.meta mknodes.o.meta mksyntax.o.meta token.h.meta stage_incs.meta mksy= ntax.meta mknodes.meta > > @ 1456524550 [2016-02-26 14:09:10] Finished bin/sh.amd64,amd64 seconds= =3D2 meta=3D49 created=3D49