From owner-freebsd-hackers@freebsd.org Sun Dec 2 00:18:55 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BAE9F132CD40; Sun, 2 Dec 2018 00:18:54 +0000 (UTC) (envelope-from james.wright@jigsawdezign.com) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.17.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 87C8E7A6E7; Sun, 2 Dec 2018 00:18:53 +0000 (UTC) (envelope-from james.wright@jigsawdezign.com) Received: from [192.168.0.11] ([82.18.193.38]) by mrelayeu.kundenserver.de (mreue108 [212.227.15.179]) with ESMTPSA (Nemesis) id 1MNso2-1grXdS2g36-00OHRh; Sun, 02 Dec 2018 01:17:54 +0100 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: How to use trim command ? From: James Wright In-Reply-To: Date: Sun, 2 Dec 2018 00:17:47 +0000 Cc: Rebecca Cran , ish@amail.plala.or.jp, "freebsd-hackers@freebsd.org" , "freebsd-hackers@freebsd.org" , Eugene Grosbein , Ian Lepore Content-Transfer-Encoding: 7bit Message-Id: <6869972A-2E15-40DF-AD69-3512928CB77F@jigsawdezign.com> References: <20181201.011411.2100982142219259108.ish@amail.plala.or.jp> <1543622218.1860.169.camel@freebsd.org> <5281174.XOh7uYVVfo@photon.int.bluestop.org> To: Warner Losh X-Mailer: Apple Mail (2.3445.9.1) X-Provags-ID: V03:K1:4pwd6Z99e3AqqgXbUd8XJ75oif02RhRdztQ/7tpfpzy1gcuISWm Zbj5EPHTMXrBjE+XyF7UO9j22gVLzx/4T2w0vKv2MKLt/s6Ie/7GKAKSq7xWUZtQYv519Gs npSo0g58TGdTYGMaO+HfJojXK/RE099FSHogWWe2Jwuq8gHYfRyydAblbQTvDbUuwy8m/RN NW5C1c/gF/vNv0JwnDo4g== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:uP8fL0HQ3/c=:pRjjwrOIqczZPgSQPid+iZ jBBn64XHyJR2cofGN4LNvAJiFr/IicX0K5aSw6EO0WXVLaFwLUMybqs90VM+yKNA3KGLJktJs DE6BKEV1DLnxbAsVMBB3gNz70qmAcoEJEdmlTCIll8LPLkrUInYmfPNGzkJY9Yy8rzgGODUUU 1Z5ycYCat9F/Kf8INNnVBu6Cw1RrG9VqsG8UIOqBpsDfGBXdnNKMSIIKhBsLSvfvif5HYL0W1 q8tlWImsT8vVuqXXrDouXqu3BG5sJXAj2LVgDyRDd5R/G4ibTmaUcMmjoMAPL8wBnBZGiA3vT GPH0k1ECdNJnWwLmoS/mkotObXsz5BDUa0Fa0F3I6twRHHXBK3Oz5hkw1YmnrC8WqPc65+9Q4 4x89UW1ua/n0n9iYOmzUBfrcfchekOamYelD7JWvH7qBP+7NCD5wU1FKcY5YpIbTgAHr1azGD xwkuhVYyzCR5dUWbtitRQFTjdhsM8UNbt4fJT/Au9fFbF5x1Sz9lYJWnDyq3B7cCc0G0jUv6M 5KQxk5KTPJVioZg1hfJfY5HZnxrQnfMqvk/PsMXcVuVES12htSFWPUJeIOuRLN47N4UZuRK45 wC2lzUqrOkX+U1LD5j1HR19bsCCE+fXnspWQmmmN+ilGeaotaZZfRnHtzUTrRzsK/WhsfBEfK K4F2ugxiJpjzAlSt9GcPCM0ixAt8mhuUtNDM0xBWsuRZuP6md8MYEMxN3dF+YkyHHeSk5iyjY 5bVbrRAsrJPzZQkGswTmpoHjG/OT2FqM8N/KxtAji24HMytrkJCMaEu2ypUI1NMYNSBC9Q1p6 V0lYpjE X-Rspamd-Queue-Id: 87C8E7A6E7 X-Spamd-Result: default: False [0.47 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; IP_SCORE(-0.04)[ipnet: 212.227.0.0/16(-0.34), asn: 8560(0.14), country: DE(-0.01)]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[jigsawdezign.com]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.15)[-0.147,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mx00.1and1.co.uk,mx01.1and1.co.uk]; NEURAL_HAM_SHORT(-0.89)[-0.892,0]; RCVD_IN_DNSWL_NONE(0.00)[13.17.227.212.list.dnswl.org : 127.0.5.0]; RCPT_COUNT_SEVEN(0.00)[7]; NEURAL_HAM_MEDIUM(-0.84)[-0.842,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 00:18:55 -0000 Borrowing somewhat from PostreSQL, how about something like "vacuum"? > On 1 Dec 2018, at 20:51, Warner Losh wrote: > > On Sat, Dec 1, 2018 at 12:50 AM Rebecca Cran via freebsd-hackers < > freebsd-hackers@freebsd.org> wrote: > >> On Friday, 30 November 2018 17:36:01 MST Eugene Grosbein wrote: >>> 01.12.2018 6:56, Ian Lepore wrote: >> >>> newfs destroys data too, cat > /dev/da0 does this too, >>> add the name "dd" itself does not imply data destruction. >> >>> Can you invent better name? >> >> 'discard'? >> > > That's a good name. trim has the unfortunate collision with the perl 'trim' > function and similar things that I didn't think of when I recommended it. > It's also nicely technology agnostic. > > Warner > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Sun Dec 2 03:41:49 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E6274130E8D0 for ; Sun, 2 Dec 2018 03:41:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x834.google.com (mail-qt1-x834.google.com [IPv6:2607:f8b0:4864:20::834]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2C42D8160A for ; Sun, 2 Dec 2018 03:41:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x834.google.com with SMTP id z16so10307621qtq.4 for ; Sat, 01 Dec 2018 19:41:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=7Pmx2QEjL3Q1dP2vjh1EZqJR1gh+HZ7ttfWDe15TAOY=; b=whT8Gc+hYrfjNxKFPQmyD+otVTrvP9p7fox7i3Xt091mR3I1B71vmm7YDqprzLyg7w dWjJ0/hbIqFNre+TsKbJdZHoK20JIdfA3ott50iUPw65kMoDWJfhnLvuiV8m0qf5mc4u IIKlDEMZX4shqpX/Tm3e5GnAty5rtDy5N/jZLhYe8S7jTjO2n+pDXlAlfSsUDhF9V0fo xCu21R0u+gp1Vt7f0Gtm8gVDHIiWUe6nPkpxi/TKO9afOkxYhYXzgJ1a0aV92y+mfy4O QY27hYVL+5Zsc5F8xarmvsDRMaSZvTw+1uXvH6daZdxSaUixeleS/7Qgj20Ot+PWw+ca WL+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=7Pmx2QEjL3Q1dP2vjh1EZqJR1gh+HZ7ttfWDe15TAOY=; b=G/26hPe91uhcCxaQIjSykQphVZbfmQ1LTldFyJEvpQzVyTx/5t0FEnYHnnLRD/m8f9 ExifZ0pUf4+AgiGh6KpJJ+XU7AsNPc5VQVlAxEojUL4YrMexA9qDUuehV4CubXF3EcoJ 20JGIo1YDkUwUhIvqgBQjk4IdScSK/C0xAB7FyY59exmagjGe96V5hEi+g8D4K+WgKnt 2GfGxqOqsse1erC3npY40jCZnesn2E2rzCxoaXbKMexbvw/dTUfjT+ngWQxnLfA2ifBQ PyCkNweJAXpB8aQMJBArN72HmdV6PltQ4p/iCIA9ZojR4nZDB1q+z1GYD4i3EtfYxXKy fIbQ== X-Gm-Message-State: AA+aEWYU9otJKVtBApQYe4GRB1GY3s2hxaSziuLmI4HnPW+Ny+BRi6Ii NI/d3qIHU3gkfSHFFa0VAST57L5IHHnDD1x8OGbOExQb X-Google-Smtp-Source: AFSGD/Wudfdi9EbSCDiBM/8Kcjeo7InZdPPor5Bi1zRqXdlpSvRW3dXF8/vaoHKcM3QsX2sZJJ+y3TtBH2+wBzh59Fk= X-Received: by 2002:aed:3881:: with SMTP id k1mr10522744qte.345.1543722107608; Sat, 01 Dec 2018 19:41:47 -0800 (PST) MIME-Version: 1.0 References: <7e69211c-6ffb-6155-b17a-a845c0b3586d@grosbein.net> <20181201.093153.893601099798031027.ish@amail.plala.or.jp> <1c7139bd-258c-e7d2-2572-052da3803b3b@freebsd.org> <20181201.202332.546134930481017424.ish@amail.plala.or.jp> <12404.1543699424@critter.freebsd.dk> <20181201222424.0ae8abfd@gumby.homeunix.com> In-Reply-To: <20181201222424.0ae8abfd@gumby.homeunix.com> From: Warner Losh Date: Sat, 1 Dec 2018 20:41:36 -0700 Message-ID: Subject: Re: How to use trim command ?,Re: How to use trim command ? To: RW Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 2C42D8160A X-Spamd-Result: default: False [-3.69 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.97)[-0.968,0]; NEURAL_HAM_LONG(-1.00)[-0.995,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[ALT1.aspmx.l.google.com,aspmx.l.google.com,ALT2.aspmx.l.google.com]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; FREEMAIL_TO(0.00)[googlemail.com]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-1.72)[ip: (-5.50), ipnet: 2607:f8b0::/32(-1.69), asn: 15169(-1.30), country: US(-0.09)]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 03:41:49 -0000 On Sat, Dec 1, 2018, 3:27 PM RW via freebsd-hackers < freebsd-hackers@freebsd.org wrote: > On Sat, 01 Dec 2018 21:23:44 +0000 > Poul-Henning Kamp wrote: > > > > Why would you run 'fsck_ffs -E' in cron anyway ? > > > > If the file-system is has TRIM enabled, it would be a no-op, unless > > there are bugs in the fs ? > > There's a school of thought that trimming in real-time, after file > deletion, slows down I/O on the device. Some people advocate > turning-off trim support in the file-system and trimming all the > unused space in one go from cron when the system is likely to be idle. > That's an interesting idea. One that would be hard to do on FreeBSD. I don't know whether there's any truth in it. It sounds unlikely with > modern drives. > I'm working on a better way to meter the TRIMs to the drive fast enough to make progress, but slow enough to not affect other operations. I think the locking will be simpler than trimd, and the feedback loop will keep trims in budget. There are still drives out there which need it. The low end is still... under resourced... Warner _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@freebsd.org Sun Dec 2 03:50:14 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F73F130EB6F for ; Sun, 2 Dec 2018 03:50:14 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x832.google.com (mail-qt1-x832.google.com [IPv6:2607:f8b0:4864:20::832]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E6BAA8187F for ; Sun, 2 Dec 2018 03:50:13 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x832.google.com with SMTP id t13so10322741qtn.3 for ; Sat, 01 Dec 2018 19:50:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=00mJLhSCDjQ2kgWz8GL13fMb5wxirwpwlDlZr2jMZZY=; b=UHW8mFGEf29R8Y9o/kC8aoBgQyMXnCgzwxm4Jnxw8iDygJhz4qQVsbR1KCwmWeapQl DcVaePXldQEOcxv37yKjV2ZIjUR3QQoDrFdVgBeMIfLu5JUyntBdwA/i8h2EOCs6Khdu ISN53mMOuoU5IJQWX8rc1lMK6DGSu1UqnyrsbXWDPQGiiFPjhtFAbDRue1i6baHMxVzC WDnh60fCfytnB6KSSkLDi4AEXqj2EelA+z0akQfB5nSS2Qzs8wEuNzlaolWswcaMmUI8 fBndy1be30UXi3pyomuo0tWKJKrK+C48jXN74QvA+3A+kwdW8SGPoWwXISwiiQ4pdNJW ExLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=00mJLhSCDjQ2kgWz8GL13fMb5wxirwpwlDlZr2jMZZY=; b=Wq7TaohCz0JIhPY8XLhhyAQeUwazMjOXiDEJuuiXjNtlas1My7kxQtCFpsvJPSUzpw qpOYB7+lu1+2vDx5ks7q47hgXiiNctzj4BnJT575gHADUVjO7KsqAzNCRhVIlCLUEpA3 c692BDg2BHjP4JkcwdJkzTYYeyp2iv3nh3X303wcFEGXMej0XN+rWZFxSiK07jXXyP/T hEydbPw8pricT3EfwZHHa99bfLlgiKHCccExM2A/WhIpuUVYsqhTAuYWNl9XX+ORDCnb uge/+Z7XBoAJiFET3n0G1EWhsQ8CgBbsUIfSipvUncWJagOuSy3yYAZ6Om5jpGKDG1nd CqLA== X-Gm-Message-State: AA+aEWbVyHLRg+7Ea8fWhwMkSy061u3Rgdczr1k782Aoia+wMw47bO2y U9Nfyt1BP73tiCm1kbcrtKZmmzITuksznKF4IdVw5Q== X-Google-Smtp-Source: AFSGD/XQEv1R5WU0/9JtPyMoBndtyZedb/utKFsHRZ2mAQpZ8djMnFs265JxCVuYFxrWiyG9JH29eQQITe5r4yRrmYM= X-Received: by 2002:aed:3881:: with SMTP id k1mr10536582qte.345.1543722613452; Sat, 01 Dec 2018 19:50:13 -0800 (PST) MIME-Version: 1.0 References: <20181201.011411.2100982142219259108.ish@amail.plala.or.jp> <1543622218.1860.169.camel@freebsd.org> <5281174.XOh7uYVVfo@photon.int.bluestop.org> In-Reply-To: From: Warner Losh Date: Sat, 1 Dec 2018 20:50:02 -0700 Message-ID: Subject: Re: How to use trim command ? To: Rick Macklem Cc: Rebecca Cran , "ish@amail.plala.or.jp" , "freebsd-hackers@freebsd.org" , "freebsd-hackers@freebsd.org" , Eugene Grosbein , Ian Lepore X-Rspamd-Queue-Id: E6BAA8187F X-Spamd-Result: default: False [-3.99 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.978,0]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_IN_DNSWL_NONE(0.00)[2.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-2.01)[ip: (-6.95), ipnet: 2607:f8b0::/32(-1.69), asn: 15169(-1.30), country: US(-0.09)]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 03:50:14 -0000 On Sat, Dec 1, 2018, 3:14 PM Rick Macklem Warner Losh wrote: > >Rebecca Cran wrote: > >> On Friday, 30 November 2018 17:36:01 MST Eugene Grosbein wrote: > >> > 01.12.2018 6:56, Ian Lepore wrote: > >> > >> > newfs destroys data too, cat > /dev/da0 does this too, > >> > add the name "dd" itself does not imply data destruction. > >> > >> > Can you invent better name? > >> > >> 'discard'? > >> > > > >That's a good name. trim has the unfortunate collision with the perl > 'trim' > >function and similar things that I didn't think of when I recommended it. > >It's also nicely technology agnostic. > > What about something with "ssd" in it, like "ssdbulkerase" or > "ssderaseall"? > No. Nothing with ssd in it will get past me. It's not technology specific. Warner > From owner-freebsd-hackers@freebsd.org Sun Dec 2 03:47:02 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D52A6130EA4D for ; Sun, 2 Dec 2018 03:47:01 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 380CE81734 for ; Sun, 2 Dec 2018 03:47:01 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x836.google.com with SMTP id p17so10301292qtl.5 for ; Sat, 01 Dec 2018 19:47:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=5KxctOa3r6paCj6a+BTn1NOTRpSAqcW1nSaWHy2b+6E=; b=Ykv2nFVLi0csQaWiHCkBsnMOLPo/+l6hSBM9NqJMtlnn+iMZwZxhay2sE0KW/0GugE 9txUB1h5SZs0ooWFyKfV3cvYjhL86bNsUI23o2NCGkvNPq7efcF2WJIbHM0xKc4l5z2g 6AIjHOO68FMdqaHXRZJfgNS1qpaHe+0PGA+9MNMmuI0uJyFTHg7SwTagUUUtTSmJ0x6g kCCOk90ndkamrUSGamP11QCuHSBJCWNPf9fAlaSUZAViy2sqdp6ieQkOS3OoF/Gyn7u5 459emvgVZdaCVUjL+UwN57uFuBXm2Xd7bzSDb6i/NrDPPm6wqKIWeWEypQQVRWw36Q36 QHmw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5KxctOa3r6paCj6a+BTn1NOTRpSAqcW1nSaWHy2b+6E=; b=k0q7JqCVv3kEoK5JUEXev3LW9/I5fe2SLBPbsMV1kvPCd6f5lcxv5/yQvPqIEuAqSg S/RQSFCvSXt7on4sEpH88awfQRZm6+jFB4d29UH9wITp0wtsiQnTYQIXThAF+reQ+7Tc L9F86V0n5YL/nxBt7vFwgAiySdZlNqaUho81JJvuAMOm2e7qwGDKnzDNhSv1sXg3gGhp qkkexSI5fYRQSviX8J6/NZuFefDvOWtxSrB3WCH1clrGQe7kk7QKKITAXONmaLkagL6v zd+8k3lzfKa1kZCvHlVFJcDrfJf+8+s0iM9tUGcP1Q/+mYOsOxqQkpM9D2YcQztR6qa6 mUuA== X-Gm-Message-State: AA+aEWZKaUgQoOajBs6cBSiimldi6SEZqpjSLQ/PQX23mzMUKpG/OC12 0D/tHZmmKksuWTsvJji4rMAp/9p1owLNJ6yzQsxsTw== X-Google-Smtp-Source: AFSGD/UMwrfIduM+DGwIclqdqUbIxTQnoTrZWmpJQqQYWct84MKX+n7n8C9KhvvQu6djcP2VaQyaA9IQuHSa+40ockk= X-Received: by 2002:ac8:668c:: with SMTP id d12mr10591596qtp.242.1543722420501; Sat, 01 Dec 2018 19:47:00 -0800 (PST) MIME-Version: 1.0 References: <7e69211c-6ffb-6155-b17a-a845c0b3586d@grosbein.net> <20181201.093153.893601099798031027.ish@amail.plala.or.jp> <1c7139bd-258c-e7d2-2572-052da3803b3b@freebsd.org> <20181201.202332.546134930481017424.ish@amail.plala.or.jp> <12404.1543699424@critter.freebsd.dk> <20181201222424.0ae8abfd@gumby.homeunix.com> <1177.1543704042@critter.freebsd.dk> In-Reply-To: <1177.1543704042@critter.freebsd.dk> From: Warner Losh Date: Sat, 1 Dec 2018 20:46:49 -0700 Message-ID: Subject: Re: How to use trim command ?,Re: How to use trim command ? To: Poul-Henning Kamp Cc: RW , FreeBSD Hackers X-Rspamd-Queue-Id: 380CE81734 X-Spamd-Result: default: False [-2.28 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.94)[-0.943,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RCVD_COUNT_TWO(0.00)[2]; NEURAL_HAM_LONG(-0.91)[-0.914,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[6.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.80)[-0.798,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-0.62)[ipnet: 2607:f8b0::/32(-1.69), asn: 15169(-1.30), country: US(-0.09)]; FREEMAIL_CC(0.00)[googlemail.com] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 03:47:02 -0000 On Sat, Dec 1, 2018, 3:43 PM Poul-Henning Kamp -------- > In message <20181201222424.0ae8abfd@gumby.homeunix.com>, RW via > freebsd-hackers writes: > >On Sat, 01 Dec 2018 21:23:44 +0000 > > >> Why would you run 'fsck_ffs -E' in cron anyway ? > >> > >> If the file-system is has TRIM enabled, it would be a no-op, unless > >> there are bugs in the fs ? > > > >There's a school of thought that trimming in real-time, after file > >deletion, slows down I/O on the device. > > I suspect people would have reached that conclusion back when various > shady outfits started selling camera-grade FAL devices in 2.5" > form-factor. > > My advice would be to avoid any device where that pattern is observed, > because that means there is too few write buffers and paths. > Erase has become super expensive with QLC nand. And many SSDs are trying to use simpler, smaller data structures to implement its LUTs. This makes trims too expensive. There are also others that can do some trims w/o any hassles, but if you trim 5s or 10s of gig at a time, it causes issues. Then metering the trims out helps a lot... but it is very workload specific... Warner -- > Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 > phk@FreeBSD.ORG | TCP/IP since RFC 956 > FreeBSD committer | BSD since 4.3-tahoe > Never attribute to malice what can adequately be explained by incompetence. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@freebsd.org Sun Dec 2 04:34:03 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D6F5F130FF15; Sun, 2 Dec 2018 04:34:03 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EA56E836CF; Sun, 2 Dec 2018 04:34:02 +0000 (UTC) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id wB247Ofv026370; Sat, 1 Dec 2018 20:07:24 -0800 (PST) (envelope-from freebsd-rwg@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd-rwg@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id wB247NA5026369; Sat, 1 Dec 2018 20:07:23 -0800 (PST) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <201812020407.wB247NA5026369@pdx.rh.CN85.dnsmgr.net> Subject: Re: How to use trim command ? In-Reply-To: To: Warner Losh Date: Sat, 1 Dec 2018 20:07:23 -0800 (PST) CC: Rebecca Cran , ish@amail.plala.or.jp, "freebsd-hackers@freebsd.org" , "freebsd-hackers@freebsd.org" , Eugene Grosbein , Ian Lepore X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: EA56E836CF X-Spamd-Result: default: False [2.48 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.21)[0.209,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: pdx.rh.CN85.dnsmgr.net]; NEURAL_SPAM_LONG(0.70)[0.696,0]; RCPT_COUNT_SEVEN(0.00)[7]; NEURAL_HAM_SHORT(-0.30)[-0.297,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.02)[country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 04:34:04 -0000 > On Sat, Dec 1, 2018 at 12:50 AM Rebecca Cran via freebsd-hackers < > freebsd-hackers@freebsd.org> wrote: > > > On Friday, 30 November 2018 17:36:01 MST Eugene Grosbein wrote: > > > 01.12.2018 6:56, Ian Lepore wrote: > > > > > newfs destroys data too, cat > /dev/da0 does this too, > > > add the name "dd" itself does not imply data destruction. > > > > > Can you invent better name? > > > > 'discard'? > > > > That's a good name. trim has the unfortunate collision with the perl 'trim' > function and similar things that I didn't think of when I recommended it. > It's also nicely technology agnostic. That word is also used in other parts of FreeBSD in similiar situations: strip(1) - discard information from ELF objects disc, if_disc(4) - software discard network interface edsc, if_edsc(4) - Ethernet discard network interface ng_hole(4) - netgraph discard node type I was kinda suprized to see strip come up.... -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-hackers@freebsd.org Sun Dec 2 07:03:59 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C9ADB13130BA for ; Sun, 2 Dec 2018 07:03:59 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id E77668720E for ; Sun, 2 Dec 2018 07:03:58 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (unknown [192.168.55.3]) by phk.freebsd.dk (Postfix) with ESMTP id 4E93114831; Sun, 2 Dec 2018 07:03:57 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.15.2/8.15.2) with ESMTPS id wB273unD060914 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 2 Dec 2018 07:03:56 GMT (envelope-from phk@critter.freebsd.dk) Received: (from phk@localhost) by critter.freebsd.dk (8.15.2/8.15.2/Submit) id wB273ts6060913; Sun, 2 Dec 2018 07:03:55 GMT (envelope-from phk) To: Warner Losh cc: RW , FreeBSD Hackers Subject: Re: How to use trim command ?,Re: How to use trim command ? In-reply-to: From: "Poul-Henning Kamp" References: <7e69211c-6ffb-6155-b17a-a845c0b3586d@grosbein.net> <20181201.093153.893601099798031027.ish@amail.plala.or.jp> <1c7139bd-258c-e7d2-2572-052da3803b3b@freebsd.org> <20181201.202332.546134930481017424.ish@amail.plala.or.jp> <12404.1543699424@critter.freebsd.dk> <20181201222424.0ae8abfd@gumby.homeunix.com> <1177.1543704042@critter.freebsd.dk> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <60911.1543734235.1@critter.freebsd.dk> Content-Transfer-Encoding: quoted-printable Date: Sun, 02 Dec 2018 07:03:55 +0000 Message-ID: <60912.1543734235@critter.freebsd.dk> X-Rspamd-Queue-Id: E77668720E X-Spamd-Result: default: False [5.01 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.54)[0.543,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.dk]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.97)[0.974,0]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: phk.freebsd.dk]; NEURAL_SPAM_LONG(0.94)[0.936,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[phk@phk.freebsd.dk,phk@critter.freebsd.dk]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:1835, ipnet:130.225.0.0/16, country:EU]; FROM_NEQ_ENVFROM(0.00)[phk@phk.freebsd.dk,phk@critter.freebsd.dk]; IP_SCORE(0.26)[asn: 1835(1.31), country: EU(0.00)]; FREEMAIL_CC(0.00)[googlemail.com] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 07:04:00 -0000 -------- In message , Warner Losh writes: >Erase has become super expensive with QLC nand. And many SSDs are trying = to >use simpler, smaller data structures to implement its LUTs. They may not have a choice, there are patent-issues in this space. Still, I would avoid any SSD which has issues in this space for normal filesystem operations. -- = Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe = Never attribute to malice what can adequately be explained by incompetence= . From owner-freebsd-hackers@freebsd.org Sun Dec 2 07:43:49 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91C581313E48 for ; Sun, 2 Dec 2018 07:43:49 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x832.google.com (mail-qt1-x832.google.com [IPv6:2607:f8b0:4864:20::832]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CF82F88B6E for ; Sun, 2 Dec 2018 07:43:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x832.google.com with SMTP id i7so10507704qtj.10 for ; Sat, 01 Dec 2018 23:43:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=CxxDX5/01e5FU+jGbBSZ+CMpM59eqwJb7fqNXp80joU=; b=JQ9mBhypaI8fzNKSo9cqVzrcdrPfSfT1/yZkTE14sz2jmB75QG1I+lcGo9Xi/5XOjq dzjVT3WIsnqI9W65nva1N6U19HuQRin+J45+3S5ByZ9s/mUVhd5XjgO1EDtQK1EzX33d bOR6O31jKOZPlJwx1gBQohnhpwMU+pVKK3kwC+c8NC4emg7p8LoQLXpq9KdGWnJd5vtZ tfZH/L4wOnqplcDGONYp3KTmSStiBDl765gZLMLqzHpkkix7OEBva0/QXFmbyL0O/D8g aF3n+d+wjIxLCXrL/6HHNmz1HY9z2HRWY8vaCkPpXKgfKynlvy/mMnsr3f1pEk603+0M +lhQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CxxDX5/01e5FU+jGbBSZ+CMpM59eqwJb7fqNXp80joU=; b=r6J84BtnOgpAnTh6RHJZ0bX/+nLmwBnwj5VX+soVtfyE/RjrVM6PKs53FI/zLy2TGn Ft/pXc4kYxCQ1FHdem4UgubKiq+1CMJ5gPPc+RLwifsxrnUa2WBBUWLO+r5JV2Ce/RT2 zOjEGNbFfzXdv/H7WKKGBL4HSAA24XtdMzUoT+sp7oD0PUFv3w3ocLwKkjcdzBtsyY/F 2TpCOF+yYI8FzOdmorKS5n0txIz8MXJf2Xtxgefw1/RZydQ1i5IwZeDPPLZXjluLb8iF K3BYl5eLFzcGDentJeqfssg2Y3QTIKgHt5ojbPCo9AS0HQpufyh3BgteNSm+sx16KDOi ABMg== X-Gm-Message-State: AA+aEWanrjzp6Pc+a/VuAVUKa/b1cBjpgUQc3UpEgxO2EQeCJgo9jESR 0U79vghNKlfetYKxXVSscm0fziVPNchgxbjJ5Vw4dA== X-Google-Smtp-Source: AFSGD/X5bcfoHvZiHGGeQtJP0Q+G8YeGnufcgIGAXsY/bESnJjrGdpTDGXkTS9ex7iKTecfNBxV2+OmWFkAdlExTn5A= X-Received: by 2002:aed:3881:: with SMTP id k1mr10906855qte.345.1543736623171; Sat, 01 Dec 2018 23:43:43 -0800 (PST) MIME-Version: 1.0 References: <7e69211c-6ffb-6155-b17a-a845c0b3586d@grosbein.net> <20181201.093153.893601099798031027.ish@amail.plala.or.jp> <1c7139bd-258c-e7d2-2572-052da3803b3b@freebsd.org> <20181201.202332.546134930481017424.ish@amail.plala.or.jp> <12404.1543699424@critter.freebsd.dk> <20181201222424.0ae8abfd@gumby.homeunix.com> <1177.1543704042@critter.freebsd.dk> <60912.1543734235@critter.freebsd.dk> In-Reply-To: <60912.1543734235@critter.freebsd.dk> From: Warner Losh Date: Sun, 2 Dec 2018 00:43:31 -0700 Message-ID: Subject: Re: How to use trim command ?,Re: How to use trim command ? To: Poul-Henning Kamp Cc: RW , "freebsd-hackers@freebsd.org" X-Rspamd-Queue-Id: CF82F88B6E X-Spamd-Result: default: False [-3.90 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.97)[-0.971,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-1.92)[ip: (-6.52), ipnet: 2607:f8b0::/32(-1.68), asn: 15169(-1.30), country: US(-0.09)]; FREEMAIL_CC(0.00)[googlemail.com] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2018 07:43:49 -0000 On Sun, Dec 2, 2018 at 12:03 AM Poul-Henning Kamp wrote: > -------- > In message < > CANCZdfrb0gWAhSUAVvs0pBjezWgh3c_kHjriknC02KZF+MVE9A@mail.gmail.com>, > Warner Losh writes: > > >Erase has become super expensive with QLC nand. And many SSDs are trying > to > >use simpler, smaller data structures to implement its LUTs. > > They may not have a choice, there are patent-issues in this space. > > Still, I would avoid any SSD which has issues in this space for normal > filesystem operations. > Good advice, if you can afford the more expensive NAND... Cost reduction efforts have lead me to try to make such NAND suck less. Warner From owner-freebsd-hackers@freebsd.org Mon Dec 3 04:07:59 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 653C31314AB6 for ; Mon, 3 Dec 2018 04:07:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-12.consmr.mail.ne1.yahoo.com (sonic307-12.consmr.mail.ne1.yahoo.com [66.163.190.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BAB656FC1D for ; Mon, 3 Dec 2018 04:07:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: THA7kCUVM1lnLii57wr8yjcfhE8qIGzw0vOCLKNlaQ8DJofdw5ffE23b8gCRPXR 4GF6b6lpruHpyFFz4IxRmz4oupj9H659hC7VJTpO_5EBGJod2odb5iMKiopMu4L2_ig9snXreMQd ha.FjsKcjsrNOet9PvxlcrM3JaPPWFSXYUu2zUycjtPfzZE0HtdudyJT5W48RuxxNXdnEa9rIZhT 2abRPCflxUTIstyXpKVTD4N5g8KPBJAf47V5Zfu.JfiXlVmMb_BIh8Uy0ewvugCau.bzItwMOslr 1e.k0fHlj2FeWR3RT5jV.XQ.h7Q72IZvwoIzamaDZRlbGYXNo7SP3xpypw9dxyUHZg3ZR.4ePJ6E FoqcGHA_qyvp4vU3X2TsY3WfzNWlP1eodk8HofEmz5mKg_t1jpJ5Fu4hQpOEixilbTI9LwmhXZo1 GGhIwtUmqcvvIIvBq8Z7raJV1h9sOtxamkbkdGkbpdkz1njA2OwlL_KST9zcgJicB6IJqAji_hkU wYYqnXGVgFFEIRRMsO9O4F1drS8oBTB5S8mg72UV4wZwXu8ZIJqMcNjaHPEDSF9TKUNCZ.OOhR1I cFoaw1lwoUA1mYZqFaFRAGZUePvrazXEeSlKz4ot2d1k_e.mvl3qnH.R5SNDiIb8oyncEkIVFqji urdhu0Q8Nb5kohFph7Q2RWkr6HYSbUMupbxCdqfh5RQvn9z6i7MmQWI8xwwwIyzsFLFpRVMi5k2a teB6TRybwubSs4Q_dgH4YhfviIFhghp4fIXCfiIBlThrjsz1BT2yq4E0OllP7mryjVF5cQ2p78uI yzfU3UtVB0NLCBG0_l_Sb_5YF0t4mh4xwEomRIYOiGKjnBFhYwHgBVR8_WLNL6lxceCxntgHJQkA lW1g6YSNTb8MuAoB.vkeYeCpkQbShJJ3ComFBLcHuthFVrEoM4bl6G6ygesXPKPNlI9mbrOkRkn7 mJcrm0TomaZ8bM5C2Dtw.PQc.QbN6Uq9cdYq7truj0DHoiYn7rR1jyuiyn8_TYhtXwzMM3yKwEW. P0AAjc..03OEmrGBaT25.781OhJLiTKe.kocu_5mxG6PZQbJfmdkrqz.lJgU- Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.ne1.yahoo.com with HTTP; Mon, 3 Dec 2018 04:07:52 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp410.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 0abc309ed31810f102ce0da15dc4718a; Mon, 03 Dec 2018 04:07:52 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.1 \(3445.101.1\)) Subject: How to get /lib/libgcc_s.so.1 's thrown exception handling to work for the likes of powerpc64 with buildworld via devel/powerpc64-xtoolchain-gcc Message-Id: <502FA1DF-65C2-41B6-BF10-7E712CD44BA9@yahoo.com> Date: Sun, 2 Dec 2018 20:07:50 -0800 To: FreeBSD PowerPC ML , freebsd-hackers Hackers X-Mailer: Apple Mail (2.3445.101.1) X-Rspamd-Queue-Id: BAB656FC1D X-Spamd-Result: default: False [0.36 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com]; NEURAL_HAM_MEDIUM(-0.20)[-0.203,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_FROM(0.00)[yahoo.com]; NEURAL_HAM_LONG(-0.66)[-0.658,0]; NEURAL_SPAM_SHORT(0.99)[0.993,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; RCVD_IN_DNSWL_NONE(0.00)[35.190.163.66.list.dnswl.org : 127.0.5.0]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.74)[ip: (1.33), ipnet: 66.163.184.0/21(1.36), asn: 36646(1.09), country: US(-0.09)]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Dec 2018 04:07:59 -0000 [This is without the longer term technique of getting llvm's libunwind working.] The code changes in my example are deliberately set up to approximately minimize the number of lines with textual changes. The patching fixes the handling of DW_CFA_remember_state and DW_CFA_restore_state . Without the changes _Unwind_RaiseException can end up looping looking at the same frame over and over when DW_CFA_remember_state and DW_CFA_restore_state are in use. While gcc 4.2.1 generally avoids these, more modern toolchains use them. # svnlite diff --diff-cmd diff -x "-U12" = /usr/src/contrib/gcc/unwind-dw2.* Index: /usr/src/contrib/gcc/unwind-dw2.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/src/contrib/gcc/unwind-dw2.c (revision 340287) +++ /usr/src/contrib/gcc/unwind-dw2.c (working copy) @@ -949,32 +949,40 @@ case DW_CFA_remember_state: { struct frame_state_reg_info *new_rs; if (unused_rs) { new_rs =3D unused_rs; unused_rs =3D unused_rs->prev; } else new_rs =3D alloca (sizeof (struct frame_state_reg_info)); *new_rs =3D fs->regs; + new_rs->cfa_offset =3D fs->cfa_offset; + new_rs->cfa_reg =3D fs->cfa_reg; + new_rs->cfa_exp =3D fs->cfa_exp; + new_rs->cfa_how =3D fs->cfa_how; fs->regs.prev =3D new_rs; } break; case DW_CFA_restore_state: { struct frame_state_reg_info *old_rs =3D fs->regs.prev; fs->regs =3D *old_rs; + fs->cfa_offset =3D fs->regs.cfa_offset; + fs->cfa_reg =3D fs->regs.cfa_reg; + fs->cfa_exp =3D fs->regs.cfa_exp; + fs->cfa_how =3D fs->regs.cfa_how; old_rs->prev =3D unused_rs; unused_rs =3D old_rs; } break; case DW_CFA_def_cfa: insn_ptr =3D read_uleb128 (insn_ptr, &fs->cfa_reg); insn_ptr =3D read_uleb128 (insn_ptr, &utmp); fs->cfa_offset =3D utmp; fs->cfa_how =3D CFA_REG_OFFSET; break; Index: /usr/src/contrib/gcc/unwind-dw2.h =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/src/contrib/gcc/unwind-dw2.h (revision 340287) +++ /usr/src/contrib/gcc/unwind-dw2.h (working copy) @@ -28,60 +28,70 @@ Software Foundation, 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. */ /* A target can override (perhaps for backward compatibility) how many dwarf2 columns are unwound. */ #ifndef DWARF_FRAME_REGISTERS #define DWARF_FRAME_REGISTERS FIRST_PSEUDO_REGISTER #endif /* The result of interpreting the frame unwind info for a frame. This is all symbolic at this point, as none of the values can be resolved until the target pc is located. */ +enum frame_state_cfa_how_values { + CFA_UNSET, + CFA_REG_OFFSET, + CFA_EXP +}; typedef struct { /* Each register save state can be described in terms of a CFA slot, another register, or a location expression. */ struct frame_state_reg_info { struct { union { _Unwind_Word reg; _Unwind_Sword offset; const unsigned char *exp; } loc; enum { REG_UNSAVED, REG_SAVED_OFFSET, REG_SAVED_REG, REG_SAVED_EXP, REG_SAVED_VAL_OFFSET, REG_SAVED_VAL_EXP } how; } reg[DWARF_FRAME_REGISTERS+1]; /* Used to implement DW_CFA_remember_state. */ struct frame_state_reg_info *prev; + + /* The following are just for DW_CFA_{remember,restore}_state + handling. */ + /* The CFA can be described in terms of a reg+offset or a + location expression. */ + _Unwind_Sword cfa_offset; + _Unwind_Word cfa_reg; + const unsigned char *cfa_exp; + enum frame_state_cfa_how_values cfa_how; } regs; /* The CFA can be described in terms of a reg+offset or a location expression. */ _Unwind_Sword cfa_offset; _Unwind_Word cfa_reg; const unsigned char *cfa_exp; - enum { - CFA_UNSET, - CFA_REG_OFFSET, - CFA_EXP - } cfa_how; + enum frame_state_cfa_how_values cfa_how; /* The PC described by the current frame state. */ void *pc; /* The information we care about from the CIE/FDE. */ _Unwind_Personality_Fn personality; _Unwind_Sword data_align; _Unwind_Word code_align; _Unwind_Word retaddr_column; unsigned char fde_encoding; unsigned char lsda_encoding; unsigned char saw_z; Without such changes building devel/gdb and devel/kyua via, say, g++8 but still binding to /lib/libgcc_s.so.1 leads to failure of both programs: both make use of thrown c++ exceptions in normal operation and DW_CFA_remember_state and DW_CFA_restore_state end up involved. Even the following program fails, looping in __Unwind_RaiseException: #include // -O2 context used (but not required for the problem // to occur). volatile unsigned int v =3D 1; extern int f() { volatile unsigned char c =3D 'a'; v++; // despite volatile the access to v in g // was otherwise optimized out and the // std::exception was not followed by // code for f(). return c; } extern void g() { if (v) throw std::exception(); f(); // ends up inlined but the problem is demonstrated. } int main(void) { try {g();} // Used a separate function to avoid any potential // special handling of code in main. Call not // optimized out. catch (std::exception& e) {f();} return 0; } Previous to the changes the following were classified as broken by timing out without completing: # kyua report lib/atf/libatf-c++/detail/exceptions_test =3D=3D=3D> Summary Results read from = /root/.kyua/store/results.usr_tests.20181203-001618-953311.db Test cases: 3 total, 0 skipped, 0 expected failures, 0 broken, 0 failed Total time: 0.064s Using a gcc 4.2.1 based kernel and a devel/powerpc64-xtoolchain-gcc based world, I've done a complete kyua test -k /usr/tests/Kyuafile that completed. (The above report is based on that run.) The reason for the gcc 4.2.1 kernel is the crash in vnet_epair_init during the kyua test -k /usr/tests/Kyuafile run when the kernel was built by devel/powerpc64-xtoolchain-gcc . The linkage/relocation and vnet's code do not seem to be matched when devel/powerpc64-xtoolchain-gcc is used to build the kernel. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-hackers@freebsd.org Tue Dec 4 19:01:35 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1110C1317C4F for ; Tue, 4 Dec 2018 19:01:35 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f177.google.com (mail-lj1-f177.google.com [209.85.208.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E73D56CD66 for ; Tue, 4 Dec 2018 19:01:33 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f177.google.com with SMTP id s5-v6so15927884ljd.12 for ; Tue, 04 Dec 2018 11:01:33 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=hlsGTMjdicR5+mZJXctdrJdAsPBIbTs7uUp+JO6UJL8=; b=ClQArnRkcPiWRfH81YNzbjRPFQgQQj87SIFw/37SxtV21hMBSW13lt9feFkeg+eT0A Pb/gwwA0NiO7ozjqclgh/rCSxo3MVSgueweNARefUNB83o/jtSonD/26cGCoWe+X28ld 2bkbkp1XpkfVoTz2vF99S2sip5Ek7ZK1JdfDr0KZuPlbRVHxmGwEjVspxHKcssQzBT1K 1kxedBMuje+YE31mDiznB1Xt3R7NuuM8N9mIHh/5mG9URf+HxtA3/RrAl9QYHXvez8Kq lIbps0qOq6JboJA78bM69TsbCXLE8N2rSg0HW82548uheHv2jEUHMATA7BhSbmt1Vm/b z6/w== X-Gm-Message-State: AA+aEWaxnq/jLeSm2gQ5MfeZIjdvZyV/m8p8WydgY3fddckZEeApQ3Cy g4Gyud9/Hab8ZqbYFL9B+/fpQeLDVRE3pbsnM/1caL9H X-Google-Smtp-Source: AFSGD/VuOrTJ++G/YfgDik/AlQBld9auwg+PP2pdQFhD8ssE7gSVyLFq7G27KzqlAFlRy8TV1KrJYmmblvuOY61EBYM= X-Received: by 2002:a2e:9356:: with SMTP id m22-v6mr13519644ljh.135.1543949677475; Tue, 04 Dec 2018 10:54:37 -0800 (PST) MIME-Version: 1.0 From: Alan Somers Date: Tue, 4 Dec 2018 11:54:25 -0700 Message-ID: Subject: Cirrus-CI: Free FreeBSD CI testing for open-source projects To: FreeBSD Hackers X-Rspamd-Queue-Id: E73D56CD66 X-Spamd-Result: default: False [-3.91 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.93)[-0.931,0]; RCVD_IN_DNSWL_NONE(0.00)[177.208.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-0.97)[ipnet: 209.85.128.0/17(-3.47), asn: 15169(-1.28), country: US(-0.09)]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Dec 2018 19:01:35 -0000 Cirrus Labs has just released support for FreeBSD on their CI service. And they've made it free for OSS! Cirrus-CI is a cloud-based CI system for cloud-hosted software, much like Travis-CI, Appveyor, Circle-CI, etc. But it's the first* such system to support FreeBSD with no weird hacks required. It also runs each test in a full VM, so you can mount filesystems, create jails, etc. The free tier supports runs on a dual CPU VM with 4GB of RAM. But if that's not enough, you can cheaply configure Cirrus to use a custom VM in Google Cloud (gcp account required; cheap but not free). https://cirrus-ci.org/guide/FreeBSD/ -Alan * Actually, https://sr.ht was first, but it's still pretty alpha-ish. From owner-freebsd-hackers@freebsd.org Thu Dec 6 13:49:41 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C36D7132DF5C for ; Thu, 6 Dec 2018 13:49:40 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 25D2A6C503 for ; Thu, 6 Dec 2018 13:49:40 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 7A69F21E31 for ; Thu, 6 Dec 2018 08:49:39 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Thu, 06 Dec 2018 08:49:39 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h=to :from:subject:message-id:date:mime-version:content-type; s=fm3; bh=U2LFW1FY9rQ1UtJSXTbNlfSmJKXkwPXSEkiRWgnTW6E=; b=GgVMux2DYDFn Vsztf2JGdqfUUQh0/wfAxgwUi+DPeQZLQJ1YX3/rvn5g2l1snax5vYqG/y9d8oni 7ENB2ZH7RkW30Iv8ng2/CDaTTPQq2QEeGl8r0eL3U2APUTm8lj/joeHjv95nSF5J gbSsF7L8LLvkH68fSGimMyayau3oyVw1g8PUCJer+mrbaW/RgRdoU3WGjmgGNSad sQ+aZxex3DCOUX5ZfwVW4a6C4NTJj91b7ZPy1m2PwTcEa2uDiD5IOs0QL3WbV2H2 u7aZNFZcGHB4HBI4Cb4UPrbXsYitoGqa4aMzc21+dEULY5uH6M3H1QJjG80cA1mC BE6xL5oFZw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=U2LFW1FY9rQ1UtJSXTbNlfSmJKXkw PXSEkiRWgnTW6E=; b=brsWgSUh9AD4w/jWK3qqrnq4yCTjKEuBXJ35jJ+WlFpAd 5Dcn68Y/ooI4g+nD/jPOO2BNr2+p2ms08mbSA9zGRzvlfQgX6BgvAFoFnmRKFojT 0Fi++q3pA0gkcixlrk72KjJHGwshNXhaKbmqvyTSRSj981mKzYjOFtUD+AzprqGb H9GLarTHR+pw92aHNbXgSRHBvPySZd6QI/hAUzYOsmg9Zvrg2rIFNHlaNL+o/Hwn n6hKKKxQxnqH6zdfaNYdln6nhOMdXJU/AvOATl7Mxo5eIhNfyKmbgnbZ2LhD8wYV 66v5wyNzkB5jHDdNfORAjNTUqX3pL+NFao5cEmmTA== X-ME-Sender: X-ME-Proxy: Received: from [192.168.1.2] (unknown [5.138.138.47]) by mail.messagingengine.com (Postfix) with ESMTPA id CE639103AC for ; Thu, 6 Dec 2018 08:49:37 -0500 (EST) To: freebsd-hackers From: Yuri Pankov Subject: syslog(3): stdarg.h is needed only for vsyslog() Openpgp: preference=signencrypt Autocrypt: addr=yuripv@yuripv.net; keydata= xsBNBFu8u6IBCADB11gP0QwnorrHjqAtKLHKHNHskhy0s7jqJKfx0YqXgVBKGLJ9/mjLAz0F CBNvemHSDDTs0mEZ9cBKKi6cmsav6+UQgr//yai6hvXLBJqKchSFO4MhmdvBtsGFq1yKz5Zi uhjmimKyIpgBgvMdbgGbGq6cnSB2uEPmZuJr419SVRODOkXukU+F5WHgaHzDdHAIu1asCt2B +6msxqIqlFWcXyZyTGicTGGvC/PFIsVRUtD1dIJANTC876g7DTb7LZXWiWwJpSJ4GKMXMHVX Ct9BoQ4i3nhKbOxb6Io1wsy+NFyWsTJ9KYrxKKPJP3oG8BWb/cqlFqnE4eNSsiq2q7krABEB AAHNH1l1cmkgUGFua292IDx5dXJpcHZAeXVyaXB2Lm5ldD7CwJcEEwEIAEECGwMFCQWjmoAF CwkIBwMFFQoJCAsFFgMCAQACHgECF4AWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW708wAIZ AQAKCRCTi+B/sSrhbPxBB/961alcU091O+yKT5/oReHVc/PX0Tz4sW3V44AcgLfYlrZavCro EFz90qmCrl0xqEwuAKcC4bjmL8SjPWAhSN6IH9nxdw+HeZnAPiHm/q679Bu47+nHBl3qD/9p +t1PkKeKZfaWToFMt1nq06ytSu6VLMCwLdlDNe6DReX0ex/afEqKsuaIZSKL4UYjRwklp8PU Uf98QkrfapyHB67hQMzfI4tPeJaYyv0cTgfq3kUWJx1V6Xi0b6Zxj4ZrB2TXvaMO5g7yhU9E E3WWAvoe4FgB3a7dHe8atnHhq5+Cuvm6+LD4Jh7jvMAE5UMN+xxQpnGpNghHjaCy4vXrLRBZ nhRYzsBNBFu8u6IBCADKih3Q933rDNj4ZA8FhBQ2RlmBgvwOLcDPIL3h0V7h38y3+HisgFSc XACDsdrTlYZ1bRXkD9FHENynBcv0l/3uGJDk8jaGIDE0TP8OQBRp+IaU9/BHnAqrKxTJGIol Dahy2m+yx2yhdc6B4ujWMDqCF1rWOD+ymOWw+VLllOkrHcZa5PJtX9UOGbApZl8ZTM8El4CA NN8F1bg9MWzUi+8LYoGWGc+BwsFS1OUB1c4SPgMu5fD4Wfsr9yRl06fdpEA2YT7B/j5/5RSC 0sE2Zs/tmJ/JRflHJ12ycj59ma2xQMfEJF40hZDpMFQmZvbVqgEg3ocQcltjbxlIKZ/mjC4z ABEBAAHCwHwEGAEKACYWIQT4arc+w94tPi0v/3CTi+B/sSrhbAUCW7y7ogIbDAUJBaOagAAK CRCTi+B/sSrhbIDcCACqAZMcoxUBLZa40a5b24j5i1jplvCYYb3h+Q5lt5+BFJ87kCb4dJuU D3kh2i29BrxWQWa9WNue9ozxeYkbkfXubQYXexVolRsnh64OdGsE8KvorBFBB3zdK/GRt2Jy +jsnTfUWuQllbzMP0MfhCDMk1Mo8WvDH2/cOEP/yLKf20a+cd6nLs7bidjmGXo9pyuBKAtV6 Kv+VRu54AL+A/UBYu/eB3Dtvzcnut+1Zq6KaP++kUwPwINLIk04OBDwN0zRNTiqMAFYYyz2v ZHBB6E1th/l//ZC5b9Dk0ZpFI1bYdL9ymnrZe1MqbGPnDCToQxu00T/pZCm6Z92YrZQYuNwl Message-ID: <88e61e33-7b4b-99e4-617c-7ed63dfddb83@yuripv.net> Date: Thu, 6 Dec 2018 16:49:31 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Thunderbird/60.3.2 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="bgP3wppoj9jwE7sDHow1tUAsplXpMgrkf" X-Rspamd-Queue-Id: 25D2A6C503 X-Spamd-Result: default: False [-7.43 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[yuripv.net,messagingengine.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[yuripv.net]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(-1.73)[ipnet: 66.111.4.0/24(-4.74), asn: 11403(-3.84), country: US(-0.09)]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: in2-smtp.messagingengine.com]; DKIM_TRACE(0.00)[yuripv.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-0.99)[-0.985,0]; SIGNED_PGP(-2.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[25.4.111.66.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Dec 2018 13:49:41 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --bgP3wppoj9jwE7sDHow1tUAsplXpMgrkf Content-Type: multipart/mixed; boundary="NPVxas6IsfFF8rue5nNRbsCANCrsDnhxO"; protected-headers="v1" From: Yuri Pankov To: freebsd-hackers Message-ID: <88e61e33-7b4b-99e4-617c-7ed63dfddb83@yuripv.net> Subject: syslog(3): stdarg.h is needed only for vsyslog() --NPVxas6IsfFF8rue5nNRbsCANCrsDnhxO Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Hi, This could use a review: https://reviews.freebsd.org/D18334. While it seems to be obvious, I could be missing something here still. --NPVxas6IsfFF8rue5nNRbsCANCrsDnhxO-- --bgP3wppoj9jwE7sDHow1tUAsplXpMgrkf Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlwJKOsACgkQk4vgf7Eq 4WyMmAf9Gjo1lKHDyNHBzFMLUKzTMtpTUAl3Bm2PrBW9A/W9dHGg/LBgo2JV1Dei Y1lUSSZPSLwi6wxAre2ocAYg0SzhfW6EPEpjVljTRsn/3tpi40FuhJEYBiRGMeeL jDYnwS9XqvA8YtIkybVEyW+IIPsoN+b9lKsbDvsPO3C3Kxc65rMghXN4eJrSOZVd /hfTHL1YySNgvzzPNlkOrwtbuMUO8nO+FX305e3Y97XsQNL+qdfwGELFR4bgQw+p XzQWlfkYPqguSQnjSk8MpzkHhTPzcgFs501097qOvMKJK9yAVfMHN3bKljlg3Y06 2a89BpvOVtXrE78XTuobTMOW6gqTCA== =0QH/ -----END PGP SIGNATURE----- --bgP3wppoj9jwE7sDHow1tUAsplXpMgrkf-- From owner-freebsd-hackers@freebsd.org Fri Dec 7 23:19:44 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 104EA132340D; Fri, 7 Dec 2018 23:19:44 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 04D557C2C5; Fri, 7 Dec 2018 23:19:42 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB7N6MBa022719 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 15:06:22 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB7N6MuB022718; Fri, 7 Dec 2018 15:06:22 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 15:06:22 -0800 From: Steve Kargl To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: HEADSUP: Something has gone south with -current Message-ID: <20181207230622.GA22163@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 04D557C2C5 X-Spamd-Result: default: False [-0.18 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; NEURAL_HAM_MEDIUM(-0.25)[-0.252,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.95)[-0.946,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.05)[ipnet: 128.95.0.0/16(0.12), asn: 73(0.20), country: US(-0.09)]; NEURAL_SPAM_SHORT(0.28)[0.284,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; RCPT_COUNT_TWO(0.00)[2]; MX_GOOD(-0.01)[troutmask.apl.washington.edu]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Dec 2018 23:19:44 -0000 Dell 7510 laptop was happily running FreeBSD12-alpha9 from Oct. 10th. I decided to update to top-of-tree today, which would be FreeBSD13 at r341703. % cd /usr/obj % rm -rf usr % cd ../src % svn update % make -j6 buildwould (OK) % make -j6 buildkernel (OK) % make installkernel (OK) % mergemaster -p % % mount -a % cd /usr/src % make installworld Dies with a segfault in make(1) half way through the update. /sbin has been update. Rebooted with new kernel. Laptop locks up. Rebooted with kernel.old/kernel (known good kernel). Laptop locks up. Rebooted with verbose info. Lockup occurs right after Starting /sbin/init is printed to console. Reboot to Dell laptop BIOS and run system diagnostics. Reboot with old FreeBSD installation cdrom. Mounted the laptop's root filesystem on /mnt. % chflags nochgs /mnt/sbin/init % cp /mnt/sbin/init.bak /mnt/sbin/init Reboot laptop and finally get back to multi-user mode. Post trauma analysis make core dumps. devd core dumps. init core dumps. cc core dumps. c++ core dumps. Something seems to be broken. -- Steve From owner-freebsd-hackers@freebsd.org Fri Dec 7 23:24:54 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4C6F01323814 for ; Fri, 7 Dec 2018 23:24:54 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-pl1-x629.google.com (mail-pl1-x629.google.com [IPv6:2607:f8b0:4864:20::629]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 775617C85E for ; Fri, 7 Dec 2018 23:24:53 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-pl1-x629.google.com with SMTP id w4so2498866plz.1 for ; Fri, 07 Dec 2018 15:24:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=nglUrgabe6S6V7i7SCuS++yn7jqCLiQPS9cwiYKTNqY=; b=BbJcY1mIQC4gNF3MyNMpGY/dMi5QhX1K6+fq6G5v2ykp/GZkLuPM3rV91hqRnJ/bOS rBSoKvyF6eb2BW3pfoS8Qu+7vHyCDtMW/jzVSFs9mGo33ZGlKTh6QbXUx2z6L+czPpCl mbfpScfOnOoQsu+Q5SZaBYfFgxMH48fK6ZaGuSJTdXoUN7n5JeHQQNSFZYbbSEA9b798 7NBZe1FvYMCkODtdHKqcja38sxKzBS4UdPLRhLWlqyLfDcjU9iwUebBwa+KtnRzN6LpT 9NsPyVapkJE7vdE11xVVy8gKUvTWiT0knfjeKLiHclrlVwwPPWXjrIcXxkp22q0KOVkj dQ+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=nglUrgabe6S6V7i7SCuS++yn7jqCLiQPS9cwiYKTNqY=; b=BB720zbVHl5GB977uYrOHwOuTHS1G2jloyPPqYlipHztb9OvdbIZV2G02l2d3hgvUg /a/8G+cfvIaa/r3BVLIyoT4sUt/m2IUyJeqxtVtIqCJ5pkGITc/0hfOZLbijMuvitvyA Qa9gSBKUFhVB3EjySwBIMGlh86sPZO2PPJ9Zfqfq77zwgpHP5jIcT+nQ+kQeeHDlcIVk DweTEm3iNntSEsHus58Q8pmuiT3ZD6a86Tte0Uq7SLH+I5V9u7FgYpXuYUwBZ4ZGWhTm HBn49tldnL12JoXhiaYWbgmQwl9Fkqpkp2+qSq4oAwhvZTGMORWlpvbLWla/tpIiPtsE g/JQ== X-Gm-Message-State: AA+aEWah9cZtvJBr4gnjE6YhzaeGfTNhIPwZFp8NUUXeQl8X7k9+lcx5 OfYEppK55TvCzWcUGjyCwwCW+xqDmrluVQ== X-Google-Smtp-Source: AFSGD/USkmfQ6Js33IQ2M/mZA3yPmMb2pRG9HeAqp8vm1kX9IkKQqVRlQko50q8kUlL64MUNKDGAuA== X-Received: by 2002:a17:902:724a:: with SMTP id c10mr4049067pll.51.1544225092314; Fri, 07 Dec 2018 15:24:52 -0800 (PST) Received: from mutt-hbsd (exit1.ipredator.se. [197.231.221.211]) by smtp.gmail.com with ESMTPSA id b5sm10911544pfc.150.2018.12.07.15.24.47 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 07 Dec 2018 15:24:51 -0800 (PST) Date: Fri, 7 Dec 2018 18:23:57 -0500 From: Shawn Webb To: Steve Kargl Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181207232357.iokl7ay2orkhmdt4@mutt-hbsd> References: <20181207230622.GA22163@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="taleijifbmw2dujf" Content-Disposition: inline In-Reply-To: <20181207230622.GA22163@troutmask.apl.washington.edu> X-Operating-System: FreeBSD mutt-hbsd 13.0-CURRENT FreeBSD 13.0-CURRENT HARDENEDBSD-13-CURRENT amd64 X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: NeoMutt/20180716 X-Rspamd-Queue-Id: 775617C85E X-Spamd-Result: default: False [-5.56 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[hardenedbsd.org]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DKIM_TRACE(0.00)[hardenedbsd.org:+]; RCVD_IN_DNSWL_NONE(0.00)[9.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.86)[-0.863,0]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; IP_SCORE(-0.58)[ipnet: 2607:f8b0::/32(-1.53), asn: 15169(-1.31), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Dec 2018 23:24:54 -0000 --taleijifbmw2dujf Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > Dell 7510 laptop was happily running FreeBSD12-alpha9 > from Oct. 10th. I decided to update to top-of-tree > today, which would be FreeBSD13 at r341703. >=20 > % cd /usr/obj > % rm -rf usr > % cd ../src > % svn update > % make -j6 buildwould (OK) > % make -j6 buildkernel (OK) > % make installkernel (OK) > % mergemaster -p > % > % mount -a > % cd /usr/src > % make installworld >=20 > Dies with a segfault in make(1) half way through the update. > /sbin has been update. >=20 > Rebooted with new kernel. Laptop locks up. > Rebooted with kernel.old/kernel (known good kernel). Laptop locks up. > Rebooted with verbose info. Lockup occurs right after >=20 > Starting /sbin/init >=20 > is printed to console. >=20 > Reboot to Dell laptop BIOS and run system diagnostics. >=20 > Reboot with old FreeBSD installation cdrom. Mounted the > laptop's root filesystem on /mnt. >=20 > % chflags nochgs /mnt/sbin/init > % cp /mnt/sbin/init.bak /mnt/sbin/init >=20 > Reboot laptop and finally get back to multi-user mode. Post trauma > analysis >=20 > make core dumps. > devd core dumps. > init core dumps. > cc core dumps. =20 > c++ core dumps. >=20 > Something seems to be broken. There have been (and still are) issues with the introduction of ifunc in libc (r339898). The symptoms you're describing sound a lot like the symptoms I experienced early on. Do you have any non-standard settings in make.conf/src.conf? Thanks, --=20 Shawn Webb Cofounder and Security Engineer HardenedBSD Tor-ified Signal: +1 443-546-8752 Tor+XMPP+OTR: lattera@is.a.hacker.sx GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --taleijifbmw2dujf Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEKrq2ve9q9Ia+iT2eaoRlj1JFbu4FAlwLAQkACgkQaoRlj1JF bu6n7Q//eoX4s/lNz7haPTqHhFkK4nTgEWY3AbnTdShrnVTTqn9owUb+VhiRlSME tq8CPmNcZ4LKjAg9NHlLw8VLQi/F4H1PvRuTzn8imUDE5nQDI0sJnOKpnvHoWn6b 6wTVBbIKZSa37j1v2zdtAbqgC9hQtukmzaZ7X6fUcZudMD1HJk5foZ9rVrMhaufL F/YeHBRPYrCOL75gZfYGxuhtPIfYme8yswFMKOpzFn7yT1VMR638E8Czdqwp5Xt9 KesfTUx/U+EbOS6V836zAQ7Xy0Hk55x6jCryZ+Wm8YhDvNH0Hs+AtrlffNhZNyTN 3u1LxLFy9W0DEHL1L3GGmy+DH6311FVYRUOBJVpwScAM9XZzfJSE4zD4mYP0AmRQ zBnGIzQEohX55sZijYjMoEk8M2a4YpW8jQFps5zUDghFP1LRDUxXpiZUUJA8W+ZK lnVcC90SD7qX+rxVs3eCDMrblsQfsyyvBhOBXMwQ0jIgBiKT10wf3AsXR+4g2FMo oFzXWs17sIXWFqINWiVhhrlPlJKBcU1sY1bZxZ6PWMEsrMgec/z6dW6Y5rZa1Ivi 31+q99Y4ZHqtynCu/7r7UDfqiDkb7cGXXsu8z46UqQ27A1Te4dATYMJFJrW/anH2 15RLraV6jkcOLbKQqJeFsIRc0DZY+0/2YP7Nj5eOX4FpCyLfagk= =TjKk -----END PGP SIGNATURE----- --taleijifbmw2dujf-- From owner-freebsd-hackers@freebsd.org Fri Dec 7 23:30:24 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86E681323B3B; Fri, 7 Dec 2018 23:30:24 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D87FF7CD50; Fri, 7 Dec 2018 23:30:23 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB7NUJcV023134 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 15:30:19 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB7NUJEr023133; Fri, 7 Dec 2018 15:30:19 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 15:30:19 -0800 From: Steve Kargl To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181207233019.GA22981@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181207230622.GA22163@troutmask.apl.washington.edu> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: D87FF7CD50 X-Spamd-Result: default: False [2.41 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.04)[-0.039,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.32)[ip: (1.35), ipnet: 128.95.0.0/16(0.12), asn: 73(0.20), country: US(-0.09)]; NEURAL_SPAM_SHORT(0.57)[0.566,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_MEDIUM(0.88)[0.877,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Dec 2018 23:30:24 -0000 On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > make core dumps. > devd core dumps. > init core dumps. > cc core dumps. > c++ core dumps. > > Something seems to be broken. > Further investigation, as core dumps. cpp core dumps. /rescue/vi core dumps. All of these programs are statically linked. Note, ar and ranlib have static linkage, and appear to still work but these were not replaced by the failing 'make installworld'. Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar is static and not stripped and works! But, if I do cp ar ar.new strip ar ./ar This ar core dumps. So, stripping static binaries seems to break the binary. -- Steve From owner-freebsd-hackers@freebsd.org Fri Dec 7 23:36:35 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF6CF132402C; Fri, 7 Dec 2018 23:36:35 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5B8FF7D442; Fri, 7 Dec 2018 23:36:34 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB7NaW21023254 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 15:36:32 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB7NaWrl023253; Fri, 7 Dec 2018 15:36:32 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 15:36:32 -0800 From: Steve Kargl To: Shawn Webb Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181207233632.GB22981@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207232357.iokl7ay2orkhmdt4@mutt-hbsd> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181207232357.iokl7ay2orkhmdt4@mutt-hbsd> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 5B8FF7D442 X-Spamd-Result: default: False [1.45 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.68)[-0.681,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.53)[0.526,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.63)[0.629,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.29)[ip: (1.23), ipnet: 128.95.0.0/16(0.11), asn: 73(0.20), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Dec 2018 23:36:35 -0000 On Fri, Dec 07, 2018 at 06:23:57PM -0500, Shawn Webb wrote: > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > Dell 7510 laptop was happily running FreeBSD12-alpha9 > > from Oct. 10th. I decided to update to top-of-tree > > today, which would be FreeBSD13 at r341703. > > analysis > > > > make core dumps. > > devd core dumps. > > init core dumps. > > cc core dumps. > > c++ core dumps. > > > > Something seems to be broken. > > There have been (and still are) issues with the introduction of ifunc > in libc (r339898). The symptoms you're describing sound a lot like the > symptoms I experienced early on. > > Do you have any non-standard settings in make.conf/src.conf? > Both are fairly benign. make.conf contains MALLOC_PRODUCTION="YES" and src.conf contains a few WITHOUT_* options (eg, CTM, PPP, NDIS). It seems to be associated with stripping static binaries. See my follow-up post. -- Steve From owner-freebsd-hackers@freebsd.org Fri Dec 7 23:52:36 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E968A13248EF; Fri, 7 Dec 2018 23:52:35 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E425C7E015; Fri, 7 Dec 2018 23:52:34 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB7NqXUc023487 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 15:52:33 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB7NqXV1023486; Fri, 7 Dec 2018 15:52:33 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 15:52:33 -0800 From: Steve Kargl To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181207235233.GA23410@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181207233019.GA22981@troutmask.apl.washington.edu> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: E425C7E015 X-Spamd-Result: default: False [2.42 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.24)[-0.242,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.27)[ip: (1.13), ipnet: 128.95.0.0/16(0.11), asn: 73(0.20), country: US(-0.09)]; NEURAL_SPAM_SHORT(0.87)[0.872,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_MEDIUM(0.83)[0.832,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Dec 2018 23:52:36 -0000 On Fri, Dec 07, 2018 at 03:30:19PM -0800, Steve Kargl wrote: > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > > > make core dumps. > > devd core dumps. > > init core dumps. > > cc core dumps. > > c++ core dumps. > > > > Something seems to be broken. > > > > Further investigation, > as core dumps. > cpp core dumps. > /rescue/vi core dumps. > > All of these programs are statically linked. Note, ar and ranlib > have static linkage, and appear to still work but these were not > replaced by the failing 'make installworld'. > > Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar > is static and not stripped and works! But, if I do > > cp ar ar.new > strip ar > ./ar > > This ar core dumps. So, stripping static binaries seems to > break the binary. > Yep, definitely, a problem with stripping static binaries. I copied both init and devd from /usr/obj to /sbin without stripping the binaries. System rebooted as expected. -- Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 00:03:21 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BAE2213252D4; Sat, 8 Dec 2018 00:03:21 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C49FB7E798; Sat, 8 Dec 2018 00:03:20 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB803JGJ023702 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 16:03:19 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB803JLC023701; Fri, 7 Dec 2018 16:03:19 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 16:03:19 -0800 From: Steve Kargl To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208000319.GB23410@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181207235233.GA23410@troutmask.apl.washington.edu> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: C49FB7E798 X-Spamd-Result: default: False [2.23 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.38)[-0.378,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.25)[ip: (1.04), ipnet: 128.95.0.0/16(0.11), asn: 73(0.20), country: US(-0.09)]; NEURAL_SPAM_SHORT(0.86)[0.859,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_MEDIUM(0.81)[0.805,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 00:03:22 -0000 On Fri, Dec 07, 2018 at 03:52:33PM -0800, Steve Kargl wrote: > On Fri, Dec 07, 2018 at 03:30:19PM -0800, Steve Kargl wrote: > > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > > > > > make core dumps. > > > devd core dumps. > > > init core dumps. > > > cc core dumps. > > > c++ core dumps. > > > > > > Something seems to be broken. > > > > > > > Further investigation, > > as core dumps. > > cpp core dumps. > > /rescue/vi core dumps. > > > > All of these programs are statically linked. Note, ar and ranlib > > have static linkage, and appear to still work but these were not > > replaced by the failing 'make installworld'. > > > > Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar > > is static and not stripped and works! But, if I do > > > > cp ar ar.new > > strip ar > > ./ar > > > > This ar core dumps. So, stripping static binaries seems to > > break the binary. > > > > Yep, definitely, a problem with stripping static binaries. > > I copied both init and devd from /usr/obj to /sbin without > stripping the binaries. System rebooted as expected. > Don't know if it's valid, but % ./ar % gdb82 ar.new ar.core Program terminated with signal SIGSEGV, Segmentation fault. #0 0x000000000029386c in __je_malloc_tsd_boot0 () (gdb) bt #0 0x000000000029386c in __je_malloc_tsd_boot0 () #1 0x00000000002b6d08 in calloc () #2 0x000000000028275b in _thr_alloc () #3 0x000000000027ec98 in _libpthread_init () #4 0x000000000024d239 in handle_static_init () #5 0x000000000024d10e in _start () -- Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 00:08:32 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4770B1325C46; Sat, 8 Dec 2018 00:08:32 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 71FD87F1DA; Sat, 8 Dec 2018 00:08:31 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wB808KNa078936 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 8 Dec 2018 02:08:23 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wB808KNa078936 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wB808KdJ078935; Sat, 8 Dec 2018 02:08:20 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 8 Dec 2018 02:08:20 +0200 From: Konstantin Belousov To: Steve Kargl Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208000820.GM52540@kib.kiev.ua> References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181207235233.GA23410@troutmask.apl.washington.edu> User-Agent: Mutt/1.11.0 (2018-11-25) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: 71FD87F1DA X-Spamd-Result: default: False [-5.10 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; IP_SCORE(-2.11)[ip: (-2.50), ipnet: 2001:470::/32(-4.48), asn: 6939(-3.47), country: US(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 00:08:32 -0000 On Fri, Dec 07, 2018 at 03:52:33PM -0800, Steve Kargl wrote: > On Fri, Dec 07, 2018 at 03:30:19PM -0800, Steve Kargl wrote: > > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > > > > > make core dumps. > > > devd core dumps. > > > init core dumps. > > > cc core dumps. > > > c++ core dumps. > > > > > > Something seems to be broken. > > > > > > > Further investigation, > > as core dumps. > > cpp core dumps. > > /rescue/vi core dumps. > > > > All of these programs are statically linked. Note, ar and ranlib > > have static linkage, and appear to still work but these were not > > replaced by the failing 'make installworld'. > > > > Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar > > is static and not stripped and works! But, if I do > > > > cp ar ar.new > > strip ar > > ./ar > > > > This ar core dumps. So, stripping static binaries seems to > > break the binary. > > > > Yep, definitely, a problem with stripping static binaries. > > I copied both init and devd from /usr/obj to /sbin without > stripping the binaries. System rebooted as expected. Most likely this is an issue fixed by r339350. From owner-freebsd-hackers@freebsd.org Sat Dec 8 00:22:40 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 833DD132641A for ; Sat, 8 Dec 2018 00:22:40 +0000 (UTC) (envelope-from atypical@autisticstory.net) Received: from cloud-vps.localdomain (unknown [IPv6:2001:15e8:110:75a::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D62C17FB1A for ; Sat, 8 Dec 2018 00:22:39 +0000 (UTC) (envelope-from atypical@autisticstory.net) Received: from localhost (localhost [127.0.0.1]) by cloud-vps.localdomain (Postfix) with ESMTP id 11EF23FC03 for ; Sat, 8 Dec 2018 01:15:28 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mail.autisticstory.net Received: from cloud-vps.localdomain ([127.0.0.1]) by localhost (mail.autisticstory.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sBroq764L8xU for ; Sat, 8 Dec 2018 01:15:25 +0100 (CET) Received: from [192.168.1.101] (unknown [83.142.188.79]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: atypical@autisticstory.net) by cloud-vps.localdomain (Postfix) with ESMTPSA id 8934E3FA0C for ; Sat, 8 Dec 2018 01:15:25 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=autisticstory.net; s=201807; t=1544228125; bh=mnWOqn9jIqt9+e7f9cbsfNFoJzEiZz55K0ogoV8XFwY=; h=To:From:Subject:Date:From; b=TnBMtlBrzFNGM89Rselvpj1dgtk5gbIezXwbLDvqvVueelRVUMDgJfLwtfEKj2viw 50YRxCC5+V2D8b7HHcR1YzLYvAgIOA+KjgHQOWGdc6ATrijXBHo5IWNaAVvAtWHmhE UPxWWvJiJkpYZ8YWLha+N4XT1KwIQMk50bXJYQx16WOxhrg2mconNZCwQT499Wfp/h EMXZJZARNEnRcWEkVHIlGNdcT3+CRH43O/GcjJjfYp8IDYdsGjUgtNlLuXG4Wz7t/p QWLzGzktLwd5uJocJqLxaQbJ105X17jah+Kz8okf2S7MDHirQspeJs92FpmiEt8rRx BIKFXgelmGKJUBbRN2bMZsJuQnGtAKq/PPC77C9oo5FmNlJl0PAQ03Fk+4Zz94Lwos bPC8DGEBvj/IoPvS+tmVYitDoDgmFC8Y3vms8akI6P/HminpsVv++x2fmnlDOa46CD FT6Kt8YAzZ+yCtzfeBCzc9djcAUjXoN2hVtFWWQ2fbiqYSDHdXY5P8xH9bZ2lZP9+J TOf9glSxNwHLjWXsK242ugnGGdqFy53px0FKlIyLtOfeyLq+ZlRiuKZCNyg5nIU7RF V45hd3k5fkeFgr24yHXPSRAFLjCuuBfw21ziFcihzSJqfSKB3CcoUDO8E1qhP/ENwc P8T6sTxrU6dIxA8rbhNrb1gE= To: freebsd-hackers@freebsd.org From: Hubert Hauser Subject: "gptzfsboot: No ZFS pools located, can't boot." - What am I doing wrong? Openpgp: preference=signencrypt Autocrypt: addr=atypical@autisticstory.net; keydata= xsFNBFvfH1cBEADMaaPj9N4y/pGIYrpYgkmabzCa+3AP/GZH3++d7DLGcVH7cePoCKKANa/F 9LXXACQDMmkdXBPXndUAN1sZmzYiQF+E15G9U9BEx1wBJxMmevGbJ28XGIu8ZTwOcNzIlO5G yhQVbKlfckuIEMFnPhqm863a91UyyQL19/JWnDBfq/DOTmPSc/tWPfWgpJdCsI6zRWreLXCb fwVg4L3prqkJbjVIuPsKS5YBF1eII6ABqcFvlGdZFQaN6Cy/4+pswVQUAaySWG/1tYq9XMbV 6zuBl15l8txRYu0aNdnV6A6900HmeKAWCthw1JMemOggMokxU5OR8dHez0CMPDvSJaXLJr0t wZeOlcK2Z8vSE1IRyvdSbtBKWM6YzfX+hOQzxRGy3qi4Z8Pk1yx9pjtrueM1Fhz3Ag7TQNuv tLMlfYx1PgZyWVNo8K7J/D2jS/Sk6uMkgMfq5D3Ef1sJb8lh2kIxU5mRrlQQof+g/HW9iIP2 qXuylJvwNGpqGX52Hrz17B6tZaRtBnRHV2ZX4dv3LI+msGzjePrYdKPUmjdkPf8ztUps0qMY F93zXL5PEyuv9UmNeJlr+5UCcWWB9w71vSbTCqIIxTzhlQ+09118b//XTYYnolAcFb3KE5iM eMYG67OkmvAjaKFh75TKlGcQNmvX45l4kzl9guyYsysH7knJQQARAQABzSpIdWJlcnQgSGF1 c2VyIDxhdHlwaWNhbEBhdXRpc3RpY3N0b3J5Lm5ldD7CwZQEEwEIAD4WIQRJqW9Zo0ULA/tV 5BgsJbHYs2XiPQUCW98fVwIbIwUJCWYBgAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRAs JbHYs2XiPcuXEACsPUZvMEJ7wUfnRr0EEVF3jWCuTSW2cD/HJG2mgwmu0SHDQJTwn5TNUYfv Yt2fBnL6TxnJxz2gjnF7DLuk7Gpo5ABmIjuh41f4NaVIbiBdVhMjueQISSEaaMJTbg4lQpr5 kPR+SWN6om3gff7V2SJ9ZozsVl/wc1wl75ndwk87gxvZJsQxhwIB6JOWCrtnD6SbldDcrKy9 wYGTEKnZpHMQaE5BB/1BADrHICPe4V2GYVTNpV/o7cneVAPSUT/AlUJHvVq6PWEOg7ld/rWq CaW9YbR+/wSikiwY5X7F+yg33G3Ys0mHVuDnWIKhGr24C/n6g3PjWTAdpg3MTBDitYFxjucZ S1luTooCkgYIF04/weV2ghrVOvAYCbtr+oN5mvfR2BwIW6v6SChyHOUMAEYyA2SHOjlNEv7+ Ws9zEHYlYXeTYIc/KMxsSEaVSuXQfsVn5uxMHlbeJ5ypMBDdke9zh6XJ39npgkR2eFHQJIqd 4BTqQbuSJPZllhXYwaeHfMy4ZZf41JFdXLNBXeQqXvnjjugGG0IrsC72OORp9iE+/4zbO/yg BvMD0jWVO94DL/3amH4nMM0RUBXIlo0mBDeuDvB0PIAyw2/fqSuMAmykLI40JoaKIfgeMcyU bv4Ra06Lz8oLXC63T6ZKT655lLU/P1cbgJXiwGjPvjupir9nEs7BTQRb3x9XARAAsz4qZEDX HpJ7s9AJS0YWjMkG2STodEV6XNaNum5BnXUF583vJUeAH9bEGqh0CY+MDXBhs4diLGVbacpe Vzac6UBQYKdwfYeZMuX5TFvPsVBv3XGvrNfhNWFnPlTUA7r9fah4QFNcDX0nRt/y1wtGknb1 JQW3vVRb/Z0q4oemPRw1cZ7yCsgBD1yD6ib13U8VYt6v+jxavS6EKh6hXjb/gUC/KOvsm2t7 UIBV5C0b8O98Dvy5csi5qQx3x0h7IAOvchpJ8i31Ke0s7xaJf2ghW2YqfNZOujtebqbc9/uf wuNOCQkL/yRirWpe7WXGAGUbM2rsqucWWpEKaHEEc5icYEeShJOyESOvRR1aEWeNBbntXMXK KMeUzLwYlqPptTxOWApIPbKJ37fHEG8QJi2H1jyn+NKLzB75GsyydUkmj/dLAuD00OF9Nn5B iJQPNFV58Q7VL99pTBhzXDj/2ZHxnYt0dVnyxE+FEOdklIcwX1PizUwHz01nUyFn+7bjgiFS LE2/5P8p7KDnpZAJgIy06sD2g8CsM4WUzRx4VHvHFkJhEWBA/E7AE+JVdEcyzjrhbM4xPR6i GbbxdvzLkUY5puM9srCnDmEN92k8joV3gFRffd2z7wIC+fYtZAhKqJiPHBaLZRQGDwmqO85x zbZBz8BPcP10JE7I4zjXvQmywgsAEQEAAcLBfAQYAQgAJhYhBEmpb1mjRQsD+1XkGCwlsdiz ZeI9BQJb3x9XAhsMBQkJZgGAAAoJECwlsdizZeI9B3kP/iBhveI7ov5IXgSMUmeMyc0MXrUB S8F4KE6kS4o82MGXPFpJunWM8WFtJwmOt6AmtE49RzuI0tH6RPfumiCFs8oaQxfQIfOw9q1I xKgF2nGRBf40OU69K7p9tKEFhqiJRyoqyTNmdunRbMTKUPobyxbH7RArobq+YaDiu4DKZ43Z W/0yR/Z0OBavE3aXeN2ePX6JM0sF2MWBIyha4lT7va1njcgLjUHzMi0l8XLAYH/YfuDHbi3S g5rDXGuvA/DfjHV3Yup1tdx+u3X65sKmSvQ1E8Ol8QCbxyfcHWResAdBdIrBBtQ6PjTw+bS4 29UCVyUJBP8oDWv3G4F9or+rUZjVxSyVdRIsFMe7+64gcPc8GFiT2ML2WhlK15b/F6qrT/bz eT/LATJUyBhYy5FEgaN1sR0YH6PPj1yOOiFS3shY1frasSZrtQS0uOv1tbR0kC40LRwIjodT CiqqoeocxvmCcSUmdS7sO5dwk5UxqHb0pggicR4FtAi9MsAFgqQLli32uAk3sKcoweuzurGe CRZQ3j54zXYQTXMc5l4ciZrwlt9l58VJvWqJzvBxa9XY7I8Y65FfA0dr+QaGtc85Ahq4LVF4 asP53ZlxwK4U7IQC0eg+LctuAxyoViMmGUu2G4arr4N8lGkiXyzzcP9QkWD0uCaH/Ig2JsC7 sCu5NBfl Message-ID: Date: Sat, 8 Dec 2018 01:14:14 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.3.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Virus-Scanned: ClamAV using ClamSMTP X-Rspamd-Queue-Id: D62C17FB1A X-Spamd-Result: default: False [7.97 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RDNS_NONE(1.00)[]; TO_DN_NONE(0.00)[]; HFILTER_HELO_IP_A(1.00)[cloud-vps.localdomain]; HFILTER_HELO_NORES_A_OR_MX(0.30)[cloud-vps.localdomain]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[autisticstory.net:+]; DMARC_POLICY_ALLOW(-0.50)[autisticstory.net,none]; MX_GOOD(-0.01)[cached: mail.autisticstory.net]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.09)[asn: 24806(0.42), country: CZ(0.01)]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:24806, ipnet:2001:15e8::/32, country:CZ]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[autisticstory.net]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.90)[0.897,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_SPAM_MEDIUM(1.00)[0.997,0]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(1.00)[0.998,0]; R_SPF_NA(0.00)[]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; GREYLIST(0.00)[pass,body] X-Rspamd-Server: mx1.freebsd.org X-Spam: Yes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 00:22:40 -0000 I'm trying to do FreeBSD dual-boot with Debian on legacy BIOS. My partition scheme is:  - /dev/ada0 (gpt)   - /dev/ada0p1 (bios boot)   - /dev/ada0p2 (linux filesystem)   - /dev/ada0p3 (linux filesystem)   - /dev/ada0p4 (freebsd boot)   - /dev/ada0p5 (freebsd swap)   - /dev/ada0p6 (freebsd zfs) I've followed these instructions (link: https://wiki.freebsd.org/MasonLoringBliss/LegacyZFSandGELI) but unfortunately, I've got the following error during booting system: "gptzfsboot: No ZFS pools located, can't boot." What am I doing wrong? From owner-freebsd-hackers@freebsd.org Sat Dec 8 00:25:41 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6A45A1326511; Sat, 8 Dec 2018 00:25:41 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id AC73C7FC59; Sat, 8 Dec 2018 00:25:40 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB80Pd90024147 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 16:25:39 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB80PdR4024146; Fri, 7 Dec 2018 16:25:39 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 16:25:39 -0800 From: Steve Kargl To: Konstantin Belousov Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208002539.GC23410@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> <20181208000820.GM52540@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208000820.GM52540@kib.kiev.ua> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: AC73C7FC59 X-Spamd-Result: default: False [2.16 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.37)[-0.367,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.78)[0.784,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.82)[0.820,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.24)[ip: (0.97), ipnet: 128.95.0.0/16(0.10), asn: 73(0.20), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 00:25:41 -0000 On Sat, Dec 08, 2018 at 02:08:20AM +0200, Konstantin Belousov wrote: > On Fri, Dec 07, 2018 at 03:52:33PM -0800, Steve Kargl wrote: > > On Fri, Dec 07, 2018 at 03:30:19PM -0800, Steve Kargl wrote: > > > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > > > > > > > make core dumps. > > > > devd core dumps. > > > > init core dumps. > > > > cc core dumps. > > > > c++ core dumps. > > > > > > > > Something seems to be broken. > > > > > > > > > > Further investigation, > > > as core dumps. > > > cpp core dumps. > > > /rescue/vi core dumps. > > > > > > All of these programs are statically linked. Note, ar and ranlib > > > have static linkage, and appear to still work but these were not > > > replaced by the failing 'make installworld'. > > > > > > Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar > > > is static and not stripped and works! But, if I do > > > > > > cp ar ar.new > > > strip ar > > > ./ar > > > > > > This ar core dumps. So, stripping static binaries seems to > > > break the binary. > > > > > > > Yep, definitely, a problem with stripping static binaries. > > > > I copied both init and devd from /usr/obj to /sbin without > > stripping the binaries. System rebooted as expected. > > Most likely this is an issue fixed by r339350. My tree is at r341703. The last paragraph of the commit message for r339350 is Just remove filter_reloc. This fixes certain cases including statically linked binaries containing ifuncs. Stripping binaries with relocations referencing removed symbols was already broken, and after this change may still be broken in a different way. So, I guess I'm hitting the "broken in a different way". The gdb82 backtrace ends up in jemalloc. I do build world with MALLOC_PRODUCTION="YES". Perhaps, ifuncs+jemalloc aren't at production level. I have few more broken static binaries that I need to replace before I can rebuild without MALLOC_PRODUCTION. -- Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 00:43:30 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4C1F1326FBB; Sat, 8 Dec 2018 00:43:29 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F361480C96; Sat, 8 Dec 2018 00:43:28 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wB80hHhD086970 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 8 Dec 2018 02:43:20 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wB80hHhD086970 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wB80hHcf086969; Sat, 8 Dec 2018 02:43:17 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 8 Dec 2018 02:43:17 +0200 From: Konstantin Belousov To: Steve Kargl Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208004317.GN52540@kib.kiev.ua> References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> <20181208000820.GM52540@kib.kiev.ua> <20181208002539.GC23410@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208002539.GC23410@troutmask.apl.washington.edu> User-Agent: Mutt/1.11.0 (2018-11-25) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: F361480C96 X-Spamd-Result: default: False [-5.06 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.95)[-0.947,0]; IP_SCORE(-2.10)[ip: (-2.48), ipnet: 2001:470::/32(-4.48), asn: 6939(-3.47), country: US(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 00:43:30 -0000 On Fri, Dec 07, 2018 at 04:25:39PM -0800, Steve Kargl wrote: > On Sat, Dec 08, 2018 at 02:08:20AM +0200, Konstantin Belousov wrote: > > On Fri, Dec 07, 2018 at 03:52:33PM -0800, Steve Kargl wrote: > > > On Fri, Dec 07, 2018 at 03:30:19PM -0800, Steve Kargl wrote: > > > > On Fri, Dec 07, 2018 at 03:06:22PM -0800, Steve Kargl wrote: > > > > > > > > > > make core dumps. > > > > > devd core dumps. > > > > > init core dumps. > > > > > cc core dumps. > > > > > c++ core dumps. > > > > > > > > > > Something seems to be broken. > > > > > > > > > > > > > Further investigation, > > > > as core dumps. > > > > cpp core dumps. > > > > /rescue/vi core dumps. > > > > > > > > All of these programs are statically linked. Note, ar and ranlib > > > > have static linkage, and appear to still work but these were not > > > > replaced by the failing 'make installworld'. > > > > > > > > Ah, so if I go into /usr/obj/usr/src/amd64.amd64/ar, this ar > > > > is static and not stripped and works! But, if I do > > > > > > > > cp ar ar.new > > > > strip ar > > > > ./ar > > > > > > > > This ar core dumps. So, stripping static binaries seems to > > > > break the binary. > > > > > > > > > > Yep, definitely, a problem with stripping static binaries. > > > > > > I copied both init and devd from /usr/obj to /sbin without > > > stripping the binaries. System rebooted as expected. > > > > Most likely this is an issue fixed by r339350. > > My tree is at r341703. The last paragraph of the commit > message for r339350 is Which tree ? The strip that is used by install should be past this revision. > > Just remove filter_reloc. This fixes certain cases including statically > linked binaries containing ifuncs. Stripping binaries with relocations > referencing removed symbols was already broken, and after this change > may still be broken in a different way. > > So, I guess I'm hitting the "broken in a different way". > > The gdb82 backtrace ends up in jemalloc. I do build world with > MALLOC_PRODUCTION="YES". Perhaps, ifuncs+jemalloc aren't at > production level. I have few more broken static binaries that > I need to replace before I can rebuild without MALLOC_PRODUCTION. > > -- > Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 01:02:05 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4A041327A76; Sat, 8 Dec 2018 01:02:05 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C7A778249B; Sat, 8 Dec 2018 01:02:04 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB8123MB024773 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 17:02:03 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB8123xq024772; Fri, 7 Dec 2018 17:02:03 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 17:02:03 -0800 From: Steve Kargl To: Konstantin Belousov Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208010203.GA24554@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> <20181208000820.GM52540@kib.kiev.ua> <20181208002539.GC23410@troutmask.apl.washington.edu> <20181208004317.GN52540@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208004317.GN52540@kib.kiev.ua> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: C7A778249B X-Spamd-Result: default: False [1.17 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.82)[-0.821,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.31)[0.315,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.76)[0.764,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.22)[ip: (0.90), ipnet: 128.95.0.0/16(0.10), asn: 73(0.19), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 01:02:05 -0000 On Sat, Dec 08, 2018 at 02:43:17AM +0200, Konstantin Belousov wrote: > On Fri, Dec 07, 2018 at 04:25:39PM -0800, Steve Kargl wrote: > > On Sat, Dec 08, 2018 at 02:08:20AM +0200, Konstantin Belousov wrote: > > > > > > Most likely this is an issue fixed by r339350. > > > > My tree is at r341703. The last paragraph of the commit > > message for r339350 is > Which tree ? The strip that is used by install should be past this > revision. > % cd /usr/src % svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/head Relative URL: ^/head Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 341703 Node Kind: directory Schedule: normal Last Changed Author: emaste Last Changed Rev: 341703 Last Changed Date: 2018-12-07 08:52:52 -0800 (Fri, 07 Dec 2018) This is the /usr/src that has led to the broken static binaries. Looking at timestamps, I have % ls -l /usr/bin/strip -r-xr-xr-x 2 root wheel - 131144 Oct 10 17:10 /usr/bin/strip* which is the strip from my Oct 10 build. This strip did not get updated because 'make installworld' died. Does install during an installworld use the old strip instead of freshly built strip? -- Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 01:32:57 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C15C1329345; Sat, 8 Dec 2018 01:32:57 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B4192838BF; Sat, 8 Dec 2018 01:32:56 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wB81Wk3h006016 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 8 Dec 2018 03:32:49 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wB81Wk3h006016 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wB81Wkjp006015; Sat, 8 Dec 2018 03:32:46 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 8 Dec 2018 03:32:46 +0200 From: Konstantin Belousov To: Steve Kargl Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208013246.GP52540@kib.kiev.ua> References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> <20181208000820.GM52540@kib.kiev.ua> <20181208002539.GC23410@troutmask.apl.washington.edu> <20181208004317.GN52540@kib.kiev.ua> <20181208010203.GA24554@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208010203.GA24554@troutmask.apl.washington.edu> User-Agent: Mutt/1.11.0 (2018-11-25) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: B4192838BF X-Spamd-Result: default: False [-5.07 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.96)[-0.956,0]; IP_SCORE(-2.10)[ip: (-2.47), ipnet: 2001:470::/32(-4.48), asn: 6939(-3.47), country: US(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 01:32:57 -0000 On Fri, Dec 07, 2018 at 05:02:03PM -0800, Steve Kargl wrote: > On Sat, Dec 08, 2018 at 02:43:17AM +0200, Konstantin Belousov wrote: > > On Fri, Dec 07, 2018 at 04:25:39PM -0800, Steve Kargl wrote: > > > On Sat, Dec 08, 2018 at 02:08:20AM +0200, Konstantin Belousov wrote: > > > > > > > > Most likely this is an issue fixed by r339350. > > > > > > My tree is at r341703. The last paragraph of the commit > > > message for r339350 is > > Which tree ? The strip that is used by install should be past this > > revision. > > > > % cd /usr/src > % svn info > Path: . > Working Copy Root Path: /usr/src > URL: svn://svn.freebsd.org/base/head > Relative URL: ^/head > Repository Root: svn://svn.freebsd.org/base > Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f > Revision: 341703 > Node Kind: directory > Schedule: normal > Last Changed Author: emaste > Last Changed Rev: 341703 > Last Changed Date: 2018-12-07 08:52:52 -0800 (Fri, 07 Dec 2018) > > This is the /usr/src that has led to the broken static binaries. > > Looking at timestamps, I have > > % ls -l /usr/bin/strip > -r-xr-xr-x 2 root wheel - 131144 Oct 10 17:10 /usr/bin/strip* > > which is the strip from my Oct 10 build. This strip did not get > updated because 'make installworld' died. Does install during > an installworld use the old strip instead of freshly built strip? It is installed (host) strip that is used, AFAIK. You can build static lib/libelftc and usr.bin/strip from the later date and install it to get past the issue. From owner-freebsd-hackers@freebsd.org Sat Dec 8 01:27:01 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E033E1328F18; Sat, 8 Dec 2018 01:27:00 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4759383533; Sat, 8 Dec 2018 01:27:00 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id wB81QwDZ025119 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 7 Dec 2018 17:26:58 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id wB81QwYs025118; Fri, 7 Dec 2018 17:26:58 -0800 (PST) (envelope-from sgk) Date: Fri, 7 Dec 2018 17:26:58 -0800 From: Steve Kargl To: Konstantin Belousov Cc: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: HEADSUP: Something has gone south with -current Message-ID: <20181208012658.GB24554@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20181207230622.GA22163@troutmask.apl.washington.edu> <20181207233019.GA22981@troutmask.apl.washington.edu> <20181207235233.GA23410@troutmask.apl.washington.edu> <20181208000820.GM52540@kib.kiev.ua> <20181208002539.GC23410@troutmask.apl.washington.edu> <20181208004317.GN52540@kib.kiev.ua> <20181208010203.GA24554@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208010203.GA24554@troutmask.apl.washington.edu> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 4759383533 X-Spamd-Result: default: False [1.22 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.83)[-0.834,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[washington.edu]; REPLYTO_ADDR_EQ_FROM(0.00)[]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.27)[0.269,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.89)[0.886,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.21)[ip: (0.85), ipnet: 128.95.0.0/16(0.10), asn: 73(0.19), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 01:27:01 -0000 On Fri, Dec 07, 2018 at 05:02:03PM -0800, Steve Kargl wrote: > On Sat, Dec 08, 2018 at 02:43:17AM +0200, Konstantin Belousov wrote: > > On Fri, Dec 07, 2018 at 04:25:39PM -0800, Steve Kargl wrote: > > > On Sat, Dec 08, 2018 at 02:08:20AM +0200, Konstantin Belousov wrote: > > > > > > > > Most likely this is an issue fixed by r339350. > > > > > > My tree is at r341703. The last paragraph of the commit > > > message for r339350 is > > Which tree ? The strip that is used by install should be past this > > revision. > > > This is the /usr/src that has led to the broken static binaries. > > Looking at timestamps, I have > > % ls -l /usr/bin/strip > -r-xr-xr-x 2 root wheel - 131144 Oct 10 17:10 /usr/bin/strip* > > which is the strip from my Oct 10 build. This strip did not get > updated because 'make installworld' died. Does install during > an installworld use the old strip instead of freshly built strip? > Looks like /usr/src/UPDATING could use an entry about r339350. I was updating an r339290 world to r341703. This jumps across r339350. /usr/bin/strip from r339290 apparently is used during installworld, which renders a system rather broken. 20181013: At r339350, /usr/bin/strip was updated to deal with the introduction of ifuncs into FreeBSD. In particular, a /usr/bin/strip from an earlier revision can lead to a broken system. To avoid mayhem, it is suggested that one does cd /usr/src/usr.bin/objcopy make install prior to 'make installworld' -- Steve From owner-freebsd-hackers@freebsd.org Sat Dec 8 12:19:01 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 426C21312C94; Sat, 8 Dec 2018 12:19:01 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id D91CA7A6B5; Sat, 8 Dec 2018 12:19:00 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id E3D173CF5; Sat, 8 Dec 2018 15:18:59 +0300 (MSK) Date: Sat, 8 Dec 2018 15:18:59 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <135752149.20181208151859@serebryakov.spb.ru> To: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system In-Reply-To: <902729965.20181208141303@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: base64 X-Rspamd-Queue-Id: D91CA7A6B5 X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 12:19:01 -0000 SGVsbG8gTGV2LA0KDQpTYXR1cmRheSwgRGVjZW1iZXIgOCwgMjAxOCwgMjoxMzowMyBQTSwg eW91IHdyb3RlOg0KDQoNCj4gIEFub3RoZXIgc3RyYW5nZSB0aGluZyBJIG5vdGljZWQ6IHdo ZW4gc3lzdGVtIGlzIGluIHN1Y2ggc3RhdGUsICJ0b3AgLVNIIg0KPiBzaG93cyB0aGF0IHNv bWV0aW1lcyB2ZXJ5IGxvdy1wcm9maWxlIHByb2Nlc3NlcywgbGlrZSBjbG9jayBzb2Z0d2Fy ZQ0KPiBpbnRlcnJ1cHQgKCEpIGNvdWxkIGNvbnN1bWUgbGFyZ2UgYW1vdW50IG9mIENQVSBm b3Igc2hvcnQgcGVyaW9kcyB0aW1lLiBXaGVuDQo+IHN5c3RlbSBpcyBpZGxlIHRoZXJlIG5l dmVyIHdpbGwgYmUgImludHJ7c3dpNDogY2xvY2sgKDApfSIgY29uc3VtaW5nIDU1JSBDUFUN Cj4gZm9yIG9uZSAiZnJhbWUiIG9yIHNzaGQsIG9yIHNjcmVlbiBpdHNlbGYuDQogTGlrZSB0 aGlzLiBUaGlzIHN5c3RlbSBkb2Vzbid0IGhhdmUgYW55IHNpZ25pZmljYW50IG5ldHdvcmsg dHJhZmZpYyBub3cglw0Kb25seSBvbmUgc3NoIGNvbm5lY3Rpb24sIHdoaWNoIGlzIHVzZWQg YXMgY29uc29sZS4gQW5kIDYyLjMlIGZvciBuZXR3b3JrDQpjYXJkLiBXVEY/IQ0KDQogIFBJ RCBVU0VSTkFNRSAgICBQUkkgTklDRSAgIFNJWkUgICAgUkVTIFNUQVRFICAgIEMgICBUSU1F ICAgIFdDUFUgQ09NTUFORA0KMjAxMjggcm9vdCAgICAgICAgMTAxICAgIDAgICAxMDRNICAg IDc0TSBDUFUxICAgICAxICAgMDozMSAxMDAuMDAlIGNjDQogICAgMCByb290ICAgICAgICAt NzYgICAgLSAgICAgIDAgIDQ2MDhLIC0gICAgICAgIDIgIDUzOjI1ICA2Mi4yMyUga2VybmVs e2lmX2NvbmZpZ190cWdfMH0NCiAgIDExIHJvb3QgICAgICAgIC02MCAgICAtICAgICAgMCAg IDI0MEsgV0FJVCAgICAgMCAgMjU6NDUgIDI0Ljg5JSBpbnRye3N3aTQ6IGNsb2NrICgwKX0N CiAgICA5IHJvb3QgICAgICAgICAtOCAgICAtICAgICAgMCAgIDE2MEsgdHgtPnR4ICAgMCAg IDc6MzggIDI0Ljg4JSB6ZnNrZXJue3R4Z190aHJlYWRfZW50ZXJ9DQogIDk5NSByb290ICAg ICAgICAgMjQgICAgMCAgICAxN00gIDc2NzZLIHNlbGVjdCAgIDEgICAyOjIwICAxMi40NCUg c2VuZG1haWwNCjEzNzkxIHJvb3QgICAgICAgICAyNCAgICAwICAgIDI0TSAgICAxNU0gc2Vs ZWN0ICAgMCAgIDA6MDQgIDEyLjQ0JSBtYWtlDQoNCg0KDQoNCi0tIA0KQmVzdCByZWdhcmRz LA0KIExldiAgICAgICAgICAgICAgICAgICAgICAgICAgICBtYWlsdG86bGV2QEZyZWVCU0Qu b3Jn From owner-freebsd-hackers@freebsd.org Sat Dec 8 12:13:20 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8B1F131299C; Sat, 8 Dec 2018 12:13:20 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 67DDB7A41C; Sat, 8 Dec 2018 12:13:20 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 72DB13CF3; Sat, 8 Dec 2018 15:13:19 +0300 (MSK) Date: Sat, 8 Dec 2018 15:13:18 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <872315806.20181208151318@serebryakov.spb.ru> To: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system In-Reply-To: <902729965.20181208141303@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: base64 X-Rspamd-Queue-Id: 67DDB7A41C X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 12:13:21 -0000 SGVsbG8gTGV2LA0KDQpTYXR1cmRheSwgRGVjZW1iZXIgOCwgMjAxOCwgMjoxMzowMyBQTSwg eW91IHdyb3RlOg0KDQo+ICBJJ3ZlIGNoZWNrZWQgYWxsICJzdGFuZGFyZCIgcGxhY2VzIJcg Q1BVIGlzIG5vdCB0aHJvdHRsaW5nLCBTU0QgbG9va3MNCj4gcGVyZmVjdGx5IE9rIGFjY29y ZGluZyB0byBTTUFSVCBhbmQgdGhlcmUgaXMgbm8gY29tcGxhaW5zIGZyb20gQUhDSSBkcml2 ZXINCj4gYWJvdXQgdGltZW91dHMgYW5kIHN1Y2gsIHN5c3RlbSBkb2Vzbid0IHN0YXJ0IHRv IHVzZSBzd2FwLg0KIFpGUyBBUkMgd2FzIGNoZWNrZWQgdG9vLiBIZXJlIGlzIHN0YXRpc3Rp Y3MgZnJvbSB0b3Agd2hlbiBzaW5nbGUtam9iIGtlcm5lbA0KYnVpbGQgaXMgaW4gYWN0aW9u LiBBIGxvdCBvZiBmcmVlIG1lbW9yeSwgc21hbGwgQVJDLCB0b28gbXVjaCBDUFUgaXMNCmNv bnN1bWVkIGJ5IGludGVycnVwdHMsIGJ1dCB0aGVyZSBpcyBmcmVlIENQVSBjbG9ja3M6DQoN Cmxhc3QgcGlkOiAxOTQ4ODsgIGxvYWQgYXZlcmFnZXM6ICA3LjAzLCAgNS4zNSwgIDUuMTAg IHVwIDArMTQ6NDM6MDQgIDE1OjA5OjU1DQo0MTcgdGhyZWFkczogICA3IHJ1bm5pbmcsIDM5 NSBzbGVlcGluZywgMTUgd2FpdGluZw0KQ1BVIDA6IDUwLjAlIHVzZXIsICAwLjAlIG5pY2Us ICAwLjAlIHN5c3RlbSwgMTYuNCUgaW50ZXJydXB0LCAzMy42JSBpZGxlDQpDUFUgMTogMTYu NCUgdXNlciwgIDAuMCUgbmljZSwgMTYuOCUgc3lzdGVtLCAgMC4wJSBpbnRlcnJ1cHQsIDY2 LjglIGlkbGUNCkNQVSAyOiAgMC4wJSB1c2VyLCAgMC4wJSBuaWNlLCAzMy4yJSBzeXN0ZW0s ICAwLjAlIGludGVycnVwdCwgNjYuOCUgaWRsZQ0KQ1BVIDM6IDMzLjIlIHVzZXIsICAwLjAl IG5pY2UsIDMzLjIlIHN5c3RlbSwgIDAuMCUgaW50ZXJydXB0LCAzMy42JSBpZGxlDQpNZW06 IDI4TSBBY3RpdmUsIDMxNU0gSW5hY3QsIDIwNzZLIExhdW5kcnksIDI1NDFNIFdpcmVkLCAx MTI5SyBCdWYsIDUwMzFNIEZyZWUNCkFSQzogMTAyNU0gVG90YWwsIDE5N00gTUZVLCA0MTVN IE1SVSwgNTE0SyBBbm9uLCAyME0gSGVhZGVyLCAzOTJNIE90aGVyDQogICAgIDE4OU0gQ29t cHJlc3NlZCwgNTYzTSBVbmNvbXByZXNzZWQsIDIuOTg6MSBSYXRpbw0KU3dhcDogMTZHIFRv dGFsLCAxNkcgRnJlZQ0KDQoNCg0KDQotLSANCkJlc3QgcmVnYXJkcywNCiBMZXYgICAgICAg ICAgICAgICAgICAgICAgICAgICAgbWFpbHRvOmxldkBGcmVlQlNELm9yZw== From owner-freebsd-hackers@freebsd.org Sat Dec 8 12:48:57 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F07B1131433D; Sat, 8 Dec 2018 12:48:56 +0000 (UTC) (envelope-from waitman@waitman.net) Received: from mail4.protonmail.ch (mail4.protonmail.ch [185.70.40.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.protonmail.ch", Issuer "QuoVadis Global SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C72657BAEF; Sat, 8 Dec 2018 12:48:55 +0000 (UTC) (envelope-from waitman@waitman.net) Date: Sat, 08 Dec 2018 12:48:38 +0000 To: "lev@FreeBSD.org" From: Waitman Gobble Cc: "freebsd-hackers@freebsd.org" , "freebsd-current@freebsd.org" Reply-To: Waitman Gobble Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system Message-ID: In-Reply-To: <135752149.20181208151859@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> <135752149.20181208151859@serebryakov.spb.ru> Feedback-ID: a9EiCCViSiSHQ6Bx5OnM7zSE3j9mdPjjMltovBgA7v_vv_C4nKI9vbMXvmk_xW33cGmibh2zGAa2Co0Llrno4A==:Ext:ProtonMail MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-1.2 required=7.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mail.protonmail.ch X-Rspamd-Queue-Id: C72657BAEF X-Spamd-Result: default: False [-5.62 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[waitman@waitman.net]; R_DKIM_ALLOW(-0.20)[waitman.net]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MX_GOOD(-0.01)[mail.protonmail.ch]; DKIM_TRACE(0.00)[waitman.net:+]; DMARC_POLICY_ALLOW(-0.50)[waitman.net,reject]; NEURAL_HAM_SHORT(-0.77)[-0.773,0]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; RCVD_IN_DNSWL_LOW(-0.10)[27.40.70.185.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-1.74)[ipnet: 185.70.40.0/24(-4.77), asn: 19905(-3.82), country: US(-0.09)]; ASN(0.00)[asn:19905, ipnet:185.70.40.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 12:48:57 -0000 =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me= ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 On Saturday, December 8, 2018 8:18 AM, Lev Serebryakov wr= ote: > Hello Lev, > > Saturday, December 8, 2018, 2:13:03 PM, you wrote: > > > Another strange thing I noticed: when system is in such state, "top -SH= " > > shows that sometimes very low-profile processes, like clock software > > interrupt (!) could consume large amount of CPU for short periods time.= When > > system is idle there never will be "intr{swi4: clock (0)}" consuming 55= % CPU > > for one "frame" or sshd, or screen itself. > > Like this. This system doesn't have any significant network traffic now = =E2=80=94 > only one ssh connection, which is used as console. And 62.3% for network > card. WTF?! > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 20128 root 101 0 104M 74M CPU1 1 0:31 100.00% cc > 0 root -76 - 0 4608K - 2 53:25 62.23% kernel{if_config_tqg_0} > 11 root -60 - 0 240K WAIT 0 25:45 24.89% intr{swi4: clock (0)} > 9 root -8 - 0 160K tx->tx 0 7:38 24.88% zfskern{txg_thread_enter} > > 995 root 24 0 17M 7676K select 1 2:20 12.44% sendmail > 13791 root 24 0 24M 15M select 0 0:04 12.44% make > > > -------------------------------------------------------------------------= -------------------------------- > > Best regards, > Lev mailto:lev@FreeBSD.org > > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " I had super slow build for r341270, but I thought it was because I accident= ally left WITNESS option set. I killed it after about 10 hours, booted to single user and rebuilt kernel = there. Waitman From owner-freebsd-hackers@freebsd.org Sat Dec 8 13:27:38 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8B3081315C9D; Sat, 8 Dec 2018 13:27:38 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D3A0D7D56F; Sat, 8 Dec 2018 13:27:27 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id wB8DRJVL011991 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 8 Dec 2018 14:27:20 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: lev@FreeBSD.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id wB8DRIO8064618 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Sat, 8 Dec 2018 20:27:18 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system To: lev@FreeBSD.org, freebsd-hackers@freebsd.org, freebsd-current@freebsd.org References: <902729965.20181208141303@serebryakov.spb.ru> From: Eugene Grosbein Message-ID: <405867c6-b9aa-22c9-7e16-3196350a4469@grosbein.net> Date: Sat, 8 Dec 2018 20:27:13 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <902729965.20181208141303@serebryakov.spb.ru> Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: D3A0D7D56F X-Spamd-Result: default: False [-4.35 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_PERMFAIL(0.00)[]; NEURAL_HAM_SHORT(-0.93)[-0.926,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-1.83)[ip: (-3.17), ipnet: 2a01:4f8::/29(-3.47), asn: 24940(-2.48), country: DE(-0.01)]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 13:27:38 -0000 08.12.2018 18:13, Lev Serebryakov wrote: > I'm completely lost. Is it problem of software? Hardware? If it is > hardware problem what should I blame? Try using different kern.timecounter.hardware and/or kern.eventtimer.timer but first try kern.eventtimer.periodic=1 instead of default 0. If something of this helps, try going back to defaults and then disable power-saving settings, if any. From owner-freebsd-hackers@freebsd.org Sat Dec 8 11:13:07 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1486F13106CB; Sat, 8 Dec 2018 11:13:07 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 8044077F5C; Sat, 8 Dec 2018 11:13:06 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id AD2DE3CDE; Sat, 8 Dec 2018 14:13:04 +0300 (MSK) Date: Sat, 8 Dec 2018 14:13:03 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <902729965.20181208141303@serebryakov.spb.ru> To: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: base64 X-Rspamd-Queue-Id: 8044077F5C X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 11:13:07 -0000 SGVsbG8gRnJlZWJzZC1oYWNrZXJzLA0KDQogSSdtIGV4cGVyaWVuY2luZyB2ZXJ5IHN0cmFu Z2Ugc2l0dWF0aW9uIG9uIG15IGxhYiBzeXN0ZW0gd2hpY2ggaXMNCkUzLTEyMjB2MiwgOEdp QiBvZiBSQU0gYW5kIDg1MCBFVk8gU0FUQSBTU0QgKHdpdGggc2luZ2xlIFpGUyBwb29sKS4N Cg0KIEl0IHJ1bnMgQ1VSUkVOVCByMzQxMTU3LiBLZXJuZWwgaXMgYnVpbHQgKndpdGhvdXQq IElOVkFSSUFOVFMgYW5kIG90aGVyDQpoZWF2eSBkZWJ1ZyBhaWRzLg0KDQogRXZlcnl0aGlu ZyB3b3JrcyBncmVhdCCXIGJ1dCBjb21waWxhdGlvbi4gIm1ha2UgLWogKjEqIGJ1aWxka2Vy bmVsIiB0YWtlcw0KZm9yZXZlciBhbmQgZWFjaCBjb21waWxlciBpbnZvY2F0aW9uIHRha2Vz IHVwIHRvIDEwIHNlY29uZHMuIEZvciBleGFtcGxlLA0KSSd2ZSBjbG9ja2VkIGNvbXBpbGF0 aW9uIG9mIHN5cy9kZXYvYWljN3h4eC9haWM3eHh4XzkzY3g2LmMgYnkgc3RvcHdhdGNoIGFu ZA0KaXQgdGFrZXMgOSBzZWNvbmRzLiBQbGVhc2Ugbm90ZSwgaXQgaXMgU0lOR0xFIEpPQiBi dWlsZC4gSWYgSSBydW4gIm1ha2UNCi1qNCIgaXQgd2lsbCBiZSBtdWNoIGxvbmdlciBmb3Ig ZWFjaCBjb21waWxlciBvdXQgb2YgNC4gQW5kIGFsbCB0aGlzIHRpbWUNCiJjYyIgLyAiYysr IiBjb25zdW1lIDEwMCUgb2YgQ1BVLg0KDQogRXZlbiB3aGVuIGJ1aWxkIGlzIHNpbmdsZS1q b2IsIHN5c3RlbSBiZWNvbWVzIHVucmVzcG9uc2l2ZS4gV2l0aA0KNC1qb2IgYnVpbGQgcnVu bmluZyBpdCBjb3VsZCB0YWtlcyB1cCB0byBtaW51dGUgdG8gc3dpdGNoIHNjcmVlbidzIHdp bmRvd3MhDQoNCiBBbm90aGVyIHN0cmFuZ2UgdGhpbmcgSSBub3RpY2VkOiB3aGVuIHN5c3Rl bSBpcyBpbiBzdWNoIHN0YXRlLCAidG9wIC1TSCINCnNob3dzIHRoYXQgc29tZXRpbWVzIHZl cnkgbG93LXByb2ZpbGUgcHJvY2Vzc2VzLCBsaWtlIGNsb2NrIHNvZnR3YXJlDQppbnRlcnJ1 cHQgKCEpIGNvdWxkIGNvbnN1bWUgbGFyZ2UgYW1vdW50IG9mIENQVSBmb3Igc2hvcnQgcGVy aW9kcyB0aW1lLiBXaGVuDQpzeXN0ZW0gaXMgaWRsZSB0aGVyZSBuZXZlciB3aWxsIGJlICJp bnRye3N3aTQ6IGNsb2NrICgwKX0iIGNvbnN1bWluZyA1NSUgQ1BVDQpmb3Igb25lICJmcmFt ZSIgb3Igc3NoZCwgb3Igc2NyZWVuIGl0c2VsZi4NCg0KIEknbSBjb21wbGV0ZWx5IGxvc3Qu IElzIGl0IHByb2JsZW0gb2Ygc29mdHdhcmU/IEhhcmR3YXJlPyBJZiBpdCBpcw0KaGFyZHdh cmUgcHJvYmxlbSB3aGF0IHNob3VsZCBJIGJsYW1lPw0KDQogSSd2ZSBjaGVja2VkIGFsbCAi c3RhbmRhcmQiIHBsYWNlcyCXIENQVSBpcyBub3QgdGhyb3R0bGluZywgU1NEIGxvb2tzDQpw ZXJmZWN0bHkgT2sgYWNjb3JkaW5nIHRvIFNNQVJUIGFuZCB0aGVyZSBpcyBubyBjb21wbGFp bnMgZnJvbSBBSENJIGRyaXZlcg0KYWJvdXQgdGltZW91dHMgYW5kIHN1Y2gsIHN5c3RlbSBk b2Vzbid0IHN0YXJ0IHRvIHVzZSBzd2FwLg0KDQotLSANCkJlc3QgcmVnYXJkcywNCiBMZXYg ICAgICAgICAgICAgICAgICAgICAgICAgIG1haWx0bzpsZXZARnJlZUJTRC5vcmc= From owner-freebsd-hackers@freebsd.org Sat Dec 8 13:45:03 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28B591316A88; Sat, 8 Dec 2018 13:45:03 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id ABC8E7E2BC; Sat, 8 Dec 2018 13:45:02 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id CDE803D12; Sat, 8 Dec 2018 16:44:55 +0300 (MSK) Date: Sat, 8 Dec 2018 16:44:55 +0300 From: Lev Serebryakov Reply-To: Lev Serebryakov Organization: FreeBSD Message-ID: <1794522781.20181208164455@serebryakov.spb.ru> To: Eugene Grosbein , freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system In-Reply-To: <405867c6-b9aa-22c9-7e16-3196350a4469@grosbein.net> References: <902729965.20181208141303@serebryakov.spb.ru> <405867c6-b9aa-22c9-7e16-3196350a4469@grosbein.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: ABC8E7E2BC X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 13:45:03 -0000 Hello Eugene, Saturday, December 8, 2018, 4:27:13 PM, you wrote: >> I'm completely lost. Is it problem of software? Hardware? If it is >> hardware problem what should I blame? > Try using different kern.timecounter.hardware and/or kern.eventtimer.timer > but first try kern.eventtimer.periodic=1 instead of default 0. Nothing helps. I've tried periodic=1 and replace hardware and time with HPT (from TSC-Low and LAPIC), but system still "sticky" with single-job build and unresposnive with multiple-job build, and still there is strange bursts of CPU consumption from threads and processes which should be low-profile. > If something of this helps, try going back to defaults and then disable power-saving settings, if any. I'll try to disable C2/C3 and turn off Turbo as next step... -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-hackers@freebsd.org Sat Dec 8 14:20:44 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 686D31317B4A; Sat, 8 Dec 2018 14:20:44 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id B6BFF7F7F8; Sat, 8 Dec 2018 14:20:43 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id BC9D23D1D; Sat, 8 Dec 2018 17:20:42 +0300 (MSK) Date: Sat, 8 Dec 2018 17:20:42 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <1034207210.20181208172042@serebryakov.spb.ru> To: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system In-Reply-To: <902729965.20181208141303@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: B6BFF7F7F8 X-Spamd-Result: default: False [-2.96 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.96)[-0.962,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; NEURAL_HAM_LONG(-1.00)[-0.999,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 14:20:44 -0000 Hello Lev, Saturday, December 8, 2018, 2:13:03 PM, you wrote: > Even when build is single-job, system becomes unresponsive. With > 4-job build running it could takes up to minute to switch screen's windows! And even with 1-job kernel build upsmon's connection to remote upsd flickers! Unbelievable. Looks like each next compiler invocation is slower and more stressful than previous one. -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-hackers@freebsd.org Sat Dec 8 14:27:45 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8AAA131823B; Sat, 8 Dec 2018 14:27:44 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-qk1-x72e.google.com (mail-qk1-x72e.google.com [IPv6:2607:f8b0:4864:20::72e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3BCB8800DB; Sat, 8 Dec 2018 14:27:44 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: by mail-qk1-x72e.google.com with SMTP id o125so4162243qkf.3; Sat, 08 Dec 2018 06:27:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=SXVkYFTKE6IlooEgY4mKxhD50MOe2W1JgxcCurXnH4s=; b=sWGZTVlTyL0qwIasH77VweimA8/Da3f2vglEi9TESAIqtSpyYMLHiOwsnm6oDhrzwK dfc2ngj0NxN3U4UFPe9g26PGMywLEe5RWgyfBrKXMiJJGsD1jgsR17uzrtV2vSMipHBl 7VAdH6kk/sSziGHvRTPktoHkyz9owkSYqPX/hFcV8MyrkXZjVwOWG3MIPO4PDryTItKY jw7Dx2OInXkh7S39EAhRiQO+YNgFF6Oz65tEioqawZVLZ5KyuRlxQPjUWV8F+0aOO74L 10NhZOAYKBuSAu+j0u+O2UwCUE0v3bylJ61xyr+on5MlC3Gn536DzFM1jI4VNQEjU0Bd PyUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=SXVkYFTKE6IlooEgY4mKxhD50MOe2W1JgxcCurXnH4s=; b=oeIArEft/TR/16i35T4aO+GEtBoqyl/DjVlBK6kML4KufBUHbTZM4e62yXYxmGHcO+ fi1mlqefJfc9tOtVKQlPz300rLPsA/Ko+VSCPpMWnjFauzzpr5UDaNVUm88qtLeYDcT8 y0TD7bRe08sJxhHHi3atihdVLHFx+YCsGNybk5RIHPNSPkEewLiOxqdXHTGMjYYj3Ez0 DLpSzt+DuNxE2DZbRPMpPGOvjY1KSgUQVdIjltUj6kNWxoAgkKwjC23ffTPkna6INNbo qR3XfMfsTPEwmTWB/YUetuZTBpFeOsYYpLKem1Ao3KggbTc80RdTrLiyfKjVw+oPqdV/ jBjQ== X-Gm-Message-State: AA+aEWbkj+7R3H8nPTWVuX7kW4/x2hmUaDpe/spRdXIaNtOt9KpVvrbV MBz3UR69o5Kj7umk7yy2twd3Byd/+KsAbGfYD+FcNQ== X-Google-Smtp-Source: AFSGD/WEmW1P7NKjieHMKarlTpQdlenq7nW9/t3stiADg7tOWxxEKHWVuVf3jK5t1zMiUYBMA/oWlciYYsQ2X8l8boM= X-Received: by 2002:a37:a1c1:: with SMTP id k184mr5216657qke.166.1544279263648; Sat, 08 Dec 2018 06:27:43 -0800 (PST) MIME-Version: 1.0 Received: by 2002:ac8:784:0:0:0:0:0 with HTTP; Sat, 8 Dec 2018 06:27:42 -0800 (PST) In-Reply-To: <1034207210.20181208172042@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> <1034207210.20181208172042@serebryakov.spb.ru> From: Mateusz Guzik Date: Sat, 8 Dec 2018 15:27:42 +0100 Message-ID: Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system To: lev@freebsd.org Cc: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 3BCB8800DB X-Spamd-Result: default: False [-6.26 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[e.2.7.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.95)[-0.953,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; IP_SCORE(-2.30)[ip: (-8.61), ipnet: 2607:f8b0::/32(-1.48), asn: 15169(-1.30), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 14:27:45 -0000 On 12/8/18, Lev Serebryakov wrote: > Hello Lev, > > Saturday, December 8, 2018, 2:13:03 PM, you wrote: > > >> Even when build is single-job, system becomes unresponsive. With >> 4-job build running it could takes up to minute to switch screen's >> windows! > And even with 1-job kernel build upsmon's connection to remote upsd > flickers! Unbelievable. > > Looks like each next compiler invocation is slower and more stressful than > previous one. > Is this a fresh install? Can you please narrow the problem down to a specific kernel revision? Most importantly, does this show up with a 12.0 kernel? I'm running one amd box and a number of intel boxes with various cpus, no issues. -- Mateusz Guzik From owner-freebsd-hackers@freebsd.org Sat Dec 8 16:58:41 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13B4213222FB; Sat, 8 Dec 2018 16:58:41 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 90B0F85D00; Sat, 8 Dec 2018 16:58:40 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 84F3C3D4B; Sat, 8 Dec 2018 19:58:38 +0300 (MSK) Date: Sat, 8 Dec 2018 19:58:37 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <1844304999.20181208195837@serebryakov.spb.ru> To: Mateusz Guzik CC: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: Re: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system In-Reply-To: References: <902729965.20181208141303@serebryakov.spb.ru> <1034207210.20181208172042@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 90B0F85D00 X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.97)[-0.972,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 16:58:41 -0000 Hello Mateusz, Saturday, December 8, 2018, 5:27:42 PM, you wrote: >> Looks like each next compiler invocation is slower and more stressful than >> previous one. > Is this a fresh install? Almost fresh. It was installed from some rather fresh 13 snapshot and then upgraded to r341157 and custom kernel via source update. Now I'm trying to update it second time without luck. First upgrade was not so painful, as far as I can remember :-) > Can you please narrow the problem down to a specific kernel revision? I'm still not sure it is software or hardware problem. > Most importantly, does this show up with a 12.0 kernel? I didn't tried 12 kernel on this hardware. > I'm running one amd box and a number of intel boxes with various cpus, > no issues. Me too, but this is only one box which have 13 and try to compile something, all other boxes are either 11/12 or are small NanoBSD installations without toolchain... -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-hackers@freebsd.org Sat Dec 8 17:52:12 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9CF41324307 for ; Sat, 8 Dec 2018 17:52:12 +0000 (UTC) (envelope-from byuu@tutanota.com) Received: from w1.tutanota.de (w1.tutanota.de [81.3.6.162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tutanota.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B254288EAD for ; Sat, 8 Dec 2018 17:52:11 +0000 (UTC) (envelope-from byuu@tutanota.com) Received: from w2.tutanota.de (unknown [192.168.1.163]) by w1.tutanota.de (Postfix) with ESMTP id 3B937FBF152 for ; Sat, 8 Dec 2018 17:52:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tutanota.com; s=20161216; t=1544291522; bh=5Orp1Rj+IpZV1fofS4qcRkhJZ6KR101G0B+LIbF0joU=; h=Date:From:To:Subject:From; b=cVLNKQcd8wglF6nxx1e1no0MpVbwWla9wUSkobd/6JkV+9g28nTV7wshTdehMvsw5 CK5x7ox1CkfshqWxm3WSj9UabnS8PZBqv1/215XD/bpzi9n07Si3+nneFrUEp9gLE/ ykOLjt917diDjaggtu7EFN3O0pwKBlGG3t+ZQgsZa5cXbAVqT+kK383x408rAMHfCc IcqWlZvy1v+2QbqNMBOoO3h6gyErRl6FkzimircL8LJ+wPQvUV0fPCRAmpzx3GZeu5 NzWMw3GIKEq1xOK8+hMjYomnkkK4ctIGwcHbH7hQv93Kgz6yTpvZsychOnTleQeG3H EfWh0tNHkH8kQ== Date: Sat, 8 Dec 2018 18:52:01 +0100 (CET) From: To: Message-ID: Subject: I'd like to submit a kernel patch for a new sysctl to use EFI instead of ACPI for poweroff + reboot MIME-Version: 1.0 X-Rspamd-Queue-Id: B254288EAD X-Spamd-Result: default: False [-2.86 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.92)[-0.921,0]; R_DKIM_ALLOW(-0.20)[tutanota.com]; IP_SCORE(-0.00)[country: DE(-0.01)]; R_SPF_ALLOW(-0.20)[+ip4:81.3.6.160/28]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.991,0]; NEURAL_SPAM_SHORT(0.16)[0.162,0]; DKIM_TRACE(0.00)[tutanota.com:+]; DMARC_POLICY_ALLOW(-0.50)[tutanota.com,none]; FROM_NO_DN(0.00)[]; MX_GOOD(-0.01)[mail.tutanota.de,mail.tutanota.de]; RCVD_IN_DNSWL_LOW(-0.10)[162.6.3.81.list.dnswl.org : 127.0.10.1]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24679, ipnet:81.3.0.0/18, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 17:52:13 -0000 Hello, first time poster here, please go easy on me ^-^; I would like to submit a patch for inclusion to the FreeBSD kernel, but wan= t to first see if there is a chance it will be accepted before writing it o= r not. Currently, /usr/src/sys/dev/efidev/efirt.c contains the efi_reset_system() = function, which calls EFI_RESET_WARM. It's exposed in /usr/src/sys/sys/efi.= h I would like to add efi_poweroff_system() to efirt.c, which is identical to= efi_reset_system(), but with EFI_RESET_SHUTDOWN as arg1, which we have to = add as an enum item to efi.h as well (its value is 2, so it would go direct= ly after EFI_RESET_WARM.) (These two functions are wrappers to invoke the EFI Runtime Services functi= on ResetSystem with EfiResetWarm and EfiResetShutdown. FreeBSD's loader.eli= uses them to implement its reboot and poweroff commands, for example.) Next, I would like to add a patch to /usr/src/sys/dev/acpica/acpi.c to acpi= _shutdown_final to check a new kernel sysctl, not picky about the name, but= something like "hw.acpi.efi_shutdown=3D0", which can be optionally changed= to 1 by the users. It could be changed at run-time with no ill effect. When this option is set to 1, and efi_systbl_phys is not NULL (eg we are ru= nning on an EFI system), I would like to invoke efi_poweroff_system() inste= ad of AcpiEnterSleepStatePrep(ACPI_STATE_S5) This is well after all services have been halted, all disks have been detac= hed, and all USB devices have been detached. acpi_shutdown_final calls Acpi= EnterSleepStatePrep (_PTS), followed by AcpiEnterSleepState (_S5), and that= 's it. The idea is to reuse all of the shutdown handling we can. If it would be desired, I could do the same for reset events to invoke efi_= reset_system(). ... The reason I am requesting this, is because I am the owner of a Threadrippe= r 2950X with an ASRock Taichi X399M motherboard, and when I attempt to shut= down my system from FreeBSD 11.2-RELEASE or 12.0-RC3, the system hangs fore= ver and fails to power down. The call frame for this is as follows: kern_psignal(initproc, SIGUSR2); =C2=A0 kern_reboot =C2=A0 =C2=A0 shutdown_final =C2=A0 =C2=A0 =C2=A0 acpi_shutdown_final =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiEnterSleepStatePre =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiEvaluateObject =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiNsEvaluate =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiPsExecuteMethod =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiPsParseAml =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiPsParseL= oop=C2=A0 //from this point on, it likely varies per DSDT =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 WalkS= tate->AscendingCallback =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 AcpiDsExecEndOp =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 AcpiGbl_OpTypeDispatch[OpType] =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 AcpiExOpcode_1A_0T_0R =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 AcpiExSystemDoSleep =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 AcpiOsSleep =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 pause("acpislp", 300) (eg tsleep) I do not know why, but the call to pause never returns. I have tried over a= dozen things to find a fix for this: analyzing my DSDT ASL code via acpidu= mp, disabling SMT + all cores, wrapping pause in a critical section, trying= SLEEP instead of pause, trying a spinloop instead of pause, trying to skip= the AcpiEnterSleepStatePrep call, building a kernel with options ACPI_DEBU= G and trying to selectively disable every device driver and ACPI subsystem = possible (including USB) while still allowing me to get to a login prompt, = tweaking every sysctl I could find around ACPI, USB, debugging, etc. Nothin= g helped. Looking into Linux' ACPI support, they have acpi_no_s5, which they claim is= used for certain motherboards which lack an _S5 DSDT entry. I believe my proposed patch would be useful both for the case of a missing = _S5 entry, as well as for when there are bugs in FreeBSD, or the motherboar= d DSDT, or in Intel's ASL parser, or in the hardware itself. Obviously, it'= s most desirable to fix ACPI on the Threadripper + Taichi X399 platform, bu= t a sysctl as I'm proposing would be beneficial for this and future platfor= ms while users wait for a fix. If someone with kernel commit access would be interested, I can write all o= f the code against -CURRENT, and submit a diff patch for review. It would b= e only a small amount of code, maybe 30 lines or so, with appropriate error= checking and fallbacks in place. Again, I'm very new to this, so please be= ar with me. Personally, for now, I just monkey patched it into acpica.c and confirmed t= hat the concept works. If there's no interest, then I will drop the matter. Thank you everyone for your time! From owner-freebsd-hackers@freebsd.org Sat Dec 8 18:43:46 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 028CA132596E for ; Sat, 8 Dec 2018 18:43:46 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: from mail-it1-f195.google.com (mail-it1-f195.google.com [209.85.166.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 15E258AADA for ; Sat, 8 Dec 2018 18:43:45 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: by mail-it1-f195.google.com with SMTP id p197so12076370itp.0 for ; Sat, 08 Dec 2018 10:43:45 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc:content-transfer-encoding; bh=kvEXFWtSvEXciis+aResCZZlR0At88WUJjWIslkDBwA=; b=RWAGL6HDV8qIOlLqDk0FSRKXI3z3rUvV95X7EaFOqpXcvFTBEZEOkp+KH4WAngCusC c4bvF1xBO+jO1wwMFCKFYRH661I5if9GIuV4hlM0Xwb/KcaujwhPXwFL4NcYdDgnaJna 6HxgerFj0/ndyhnSIWCl0r6y/jS7HEm2yi02cZ3IlrBwz1wHDelm1HoChLJqrjB6D955 O5ItaJ84RbfocnwYNAQDb7Y2R3wKHkQaNUO9hqHmJvEwTVyvv9L4vq9D/KpmIzdQ3ITJ HuwnhSaPB+IsGor5JfRFpIwGXp/pQ6Un7dFJwit41sabo9XEZ2gYBe4iVLf0eBzhj8aR z3+Q== X-Gm-Message-State: AA+aEWYUWv9yomV2qUAVcuvJvAwmLUv8Qgo62lvZg3VcNFHllficR50n C20eFy6l682Z+l6tbLg0zoDWVLnH X-Google-Smtp-Source: AFSGD/UIU0+WiJMAoM4sjZ9uJyrWH6UKTCQB4xkO0h06kh94vXCwTeQFGV0vcSjVCmUg1Y5YdK42aw== X-Received: by 2002:a02:89dd:: with SMTP id e29mr6323418jak.21.1544294143835; Sat, 08 Dec 2018 10:35:43 -0800 (PST) Received: from mail-it1-f171.google.com (mail-it1-f171.google.com. [209.85.166.171]) by smtp.gmail.com with ESMTPSA id i135sm3515548iti.34.2018.12.08.10.35.43 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 08 Dec 2018 10:35:43 -0800 (PST) Received: by mail-it1-f171.google.com with SMTP id h65so12032136ith.3 for ; Sat, 08 Dec 2018 10:35:43 -0800 (PST) X-Received: by 2002:a24:2f82:: with SMTP id j124mr5676858itj.166.1544294143043; Sat, 08 Dec 2018 10:35:43 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: Reply-To: cem@freebsd.org From: Conrad Meyer Date: Sat, 8 Dec 2018 10:35:31 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: I'd like to submit a kernel patch for a new sysctl to use EFI instead of ACPI for poweroff + reboot To: byuu@tutanota.com Cc: "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 15E258AADA X-Spamd-Result: default: False [-3.90 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[cem@freebsd.org]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.92)[-0.919,0]; FORGED_SENDER(0.30)[cem@freebsd.org,csecem@gmail.com]; IP_SCORE(-0.98)[ipnet: 209.85.128.0/17(-3.50), asn: 15169(-1.29), country: US(-0.09)]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; FROM_NEQ_ENVFROM(0.00)[cem@freebsd.org,csecem@gmail.com]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[195.166.85.209.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[195.166.85.209.rep.mailspike.net : 127.0.0.17] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 18:43:46 -0000 Hi, I think the way you would do this properly is by adding a 'EVENTHANDLER_REGISTER(shutdown_final, efi_shutdown_final, ..., SHUTDOWN_PRI_LAST - 1);' in efidev/efirt (or '- 2', see below). Because the priority number is *lower* than acpi's (SHUTDOWN_PRI_LAST), it will be invoked *before* acpi. If an EFI shutdown is inappropriate or the particular howto mode is unsupported on that system, it can just do return doing nothing; the ACPI acpi_shutdown_final handler will be called next. You can see numerous examples of such handlers in various ARM devices which don't have ACPI (grep for 'EVENTHANDLER_REGISTER(shutdown_final'). One other relevant example on x86 is ipmi shutdown, which like I just suggested for efi shutdown, registers itself as SHUTDOWN_PRI_LAST - 1 to precede ACPI shutdown. I guess if IPMI is configured, maybe it should supersede both EFI and ACPI. So maybe your patch should bump the IPMI number to SHUTDOWN_PRI_LAST - 2 and add EFI as - 1. As hinted above, your efirt_shutdown_final() would take the place of acpi_shutdown_final() in your callstack above, called from kern_reboot() -> shutdown_final event. I hope that helps, Conrad On Sat, Dec 8, 2018 at 9:53 AM wrote: > > Hello, first time poster here, please go easy on me ^-^; > > I would like to submit a patch for inclusion to the FreeBSD kernel, but w= ant to first see if there is a chance it will be accepted before writing it= or not. > > Currently, /usr/src/sys/dev/efidev/efirt.c contains the efi_reset_system(= ) function, which calls EFI_RESET_WARM. It's exposed in /usr/src/sys/sys/ef= i.h > > I would like to add efi_poweroff_system() to efirt.c, which is identical = to efi_reset_system(), but with EFI_RESET_SHUTDOWN as arg1, which we have t= o add as an enum item to efi.h as well (its value is 2, so it would go dire= ctly after EFI_RESET_WARM.) > > (These two functions are wrappers to invoke the EFI Runtime Services func= tion ResetSystem with EfiResetWarm and EfiResetShutdown. FreeBSD's loader.e= li uses them to implement its reboot and poweroff commands, for example.) > > Next, I would like to add a patch to /usr/src/sys/dev/acpica/acpi.c to ac= pi_shutdown_final to check a new kernel sysctl, not picky about the name, b= ut something like "hw.acpi.efi_shutdown=3D0", which can be optionally chang= ed to 1 by the users. It could be changed at run-time with no ill effect. > > When this option is set to 1, and efi_systbl_phys is not NULL (eg we are = running on an EFI system), I would like to invoke efi_poweroff_system() ins= tead of AcpiEnterSleepStatePrep(ACPI_STATE_S5) > > This is well after all services have been halted, all disks have been det= ached, and all USB devices have been detached. acpi_shutdown_final calls Ac= piEnterSleepStatePrep (_PTS), followed by AcpiEnterSleepState (_S5), and th= at's it. The idea is to reuse all of the shutdown handling we can. > > If it would be desired, I could do the same for reset events to invoke ef= i_reset_system(). > > ... > > The reason I am requesting this, is because I am the owner of a Threadrip= per 2950X with an ASRock Taichi X399M motherboard, and when I attempt to sh= utdown my system from FreeBSD 11.2-RELEASE or 12.0-RC3, the system hangs fo= rever and fails to power down. The call frame for this is as follows: > > kern_psignal(initproc, SIGUSR2); > kern_reboot > shutdown_final > acpi_shutdown_final > AcpiEnterSleepStatePre > AcpiEvaluateObject > AcpiNsEvaluate > AcpiPsExecuteMethod > AcpiPsParseAml > AcpiPsParseLoop //from this point on, it likely varies= per DSDT > WalkState->AscendingCallback > AcpiDsExecEndOp > AcpiGbl_OpTypeDispatch[OpType] > AcpiExOpcode_1A_0T_0R > AcpiExSystemDoSleep > AcpiOsSleep > pause("acpislp", 300) (eg tsleep) > > I do not know why, but the call to pause never returns. I have tried over= a dozen things to find a fix for this: analyzing my DSDT ASL code via acpi= dump, disabling SMT + all cores, wrapping pause in a critical section, tryi= ng SLEEP instead of pause, trying a spinloop instead of pause, trying to sk= ip the AcpiEnterSleepStatePrep call, building a kernel with options ACPI_DE= BUG and trying to selectively disable every device driver and ACPI subsyste= m possible (including USB) while still allowing me to get to a login prompt= , tweaking every sysctl I could find around ACPI, USB, debugging, etc. Noth= ing helped. > > Looking into Linux' ACPI support, they have acpi_no_s5, which they claim = is used for certain motherboards which lack an _S5 DSDT entry. > > I believe my proposed patch would be useful both for the case of a missin= g _S5 entry, as well as for when there are bugs in FreeBSD, or the motherbo= ard DSDT, or in Intel's ASL parser, or in the hardware itself. Obviously, i= t's most desirable to fix ACPI on the Threadripper + Taichi X399 platform, = but a sysctl as I'm proposing would be beneficial for this and future platf= orms while users wait for a fix. > > If someone with kernel commit access would be interested, I can write all= of the code against -CURRENT, and submit a diff patch for review. It would= be only a small amount of code, maybe 30 lines or so, with appropriate err= or checking and fallbacks in place. Again, I'm very new to this, so please = bear with me. > > Personally, for now, I just monkey patched it into acpica.c and confirmed= that the concept works. > > If there's no interest, then I will drop the matter. > > Thank you everyone for your time! > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " From owner-freebsd-hackers@freebsd.org Sat Dec 8 19:09:47 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3F6481326717; Sat, 8 Dec 2018 19:09:47 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 8C56B8BE45; Sat, 8 Dec 2018 19:09:46 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:2830:b347:cdce:35cc]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 87ADA3D84; Sat, 8 Dec 2018 22:09:44 +0300 (MSK) Date: Sat, 8 Dec 2018 22:09:43 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <1102394497.20181208220943@serebryakov.spb.ru> To: Mateusz Guzik CC: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: ZFS sends TIRMs to agressively? (Was: Painfully slow compilation (read: "make buildworld buildkernel") on not-so-weak system) In-Reply-To: <1844304999.20181208195837@serebryakov.spb.ru> References: <902729965.20181208141303@serebryakov.spb.ru> <1034207210.20181208172042@serebryakov.spb.ru> <1844304999.20181208195837@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 8C56B8BE45 X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Dec 2018 19:09:47 -0000 Hello Lev, Saturday, December 8, 2018, 7:58:37 PM, you wrote: >> Can you please narrow the problem down to a specific kernel revision? > I'm still not sure it is software or hardware problem. Looks like Samsung 850 EVO doesn't like TRIMs sent by ZFS (and I've thought it is good SSD, consumer-grade, but really good one!). I've tuned down TRIMs with vfs.zfs.per_txg_dirty_frees_percent=10 vfs.zfs.free_max_blocks=1000 vfs.zfs.vdev.trim_max_active=4 And it MOSTLY solved problem: there are some freezing from time to time (and strange consumption of CPU by low-profile threads) with these settings. When I've disabled TRIM completely all freezes are gone, and low-profile threads consume tenths of percent of CPU, as it is intended. -- Best regards, Lev mailto:lev@FreeBSD.org