From owner-freebsd-questions@freebsd.org Sun Oct 18 10:10:56 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3FE1F42D5B5 for ; Sun, 18 Oct 2020 10:10:56 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from mail.kukulies.org (mail.kukulies.org [116.203.115.43]) by mx1.freebsd.org (Postfix) with ESMTP id 4CDbHz1dzxz4L2J for ; Sun, 18 Oct 2020 10:10:54 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from localhost (localhost [127.0.0.1]) by mail.kukulies.org (Postfix) with ESMTP id 3754710276A; Sun, 18 Oct 2020 12:10:48 +0200 (CEST) Received: from mail.kukulies.org ([127.0.0.1]) by localhost (mail.kukulies.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JiUZAN_R7hC6; Sun, 18 Oct 2020 12:10:47 +0200 (CEST) Received: from christophs-macbook-pro.fritz.box (p57a1f9fb.dip0.t-ipconnect.de [87.161.249.251]) by mail.kukulies.org (Postfix) with ESMTPSA id AADC0102769; Sun, 18 Oct 2020 12:10:47 +0200 (CEST) From: Christoph Kukulies Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_1305BF23-9668-4167-BD6F-2C41F68817B1"; protocol="application/pkcs7-signature"; micalg=sha-256 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: Which ports to install to compile gnu binutils? Date: Sun, 18 Oct 2020 12:10:46 +0200 In-Reply-To: <44y2k4cwhl.fsf@be-well.ilk.org> Cc: freebsd-questions@freebsd.org To: Lowell Gilbert References: <283908A2-7765-450B-9746-D51FF58C99B2@kukulies.org> <20201015214755.GB26691@geeks.org> <2F004468-03AA-4F02-9367-1A963F69ED38@kukulies.org> <448sc6szgz.fsf@be-well.ilk.org> <44y2k4cwhl.fsf@be-well.ilk.org> X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4CDbHz1dzxz4L2J X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of kuku@kukulies.org has no SPF policy when checking 116.203.115.43) smtp.mailfrom=kuku@kukulies.org X-Spamd-Result: default: False [-0.87 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_TWO(0.00)[2]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:24940, ipnet:116.203.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[87.161.249.251:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.58)[-0.580]; FREEFALL_USER(0.00)[kuku]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; NEURAL_SPAM_SHORT(0.11)[0.113]; NEURAL_HAM_LONG(-0.80)[-0.805]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[kukulies.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 10:10:56 -0000 --Apple-Mail=_1305BF23-9668-4167-BD6F-2C41F68817B1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > Am 18.10.2020 um 00:34 schrieb Lowell Gilbert = : >=20 > Christoph Kukulies writes: >=20 >>> Am 16.10.2020 um 22:11 schrieb Lowell Gilbert = : >>> Do you need that specific version? >>>=20 >>=20 >> Yes. Reason: I =E2=80=9Einherited=E2=80=9C a project from someone, = who passed away and >> it is to me to continue the project. He had developed everything = under >> that specific >> version of the gnu-arm toolchain. I moved everything to Unix and to = be >> sure that my build environment will produce the exact same results - >> which isn=E2=80=99t the >> case at the moment (some instructions are assembled differently) - = I=E2=80=99m in need of the exact version. >=20 > But not necessarily permanently; only until you can verify that = another > version gives you good results. [Where "good" is for you to define = based > on the project's criteria.] >=20 Yes, in principle you=E2=80=99re right. But in the first place I wanted = to be sure to produce the exact binary=20 results compared to the Windows platform. I could prove it now with the = macOS version of the cited link. =20 Later, when I=E2=80=99ll have full control over the process it might be = not so relevant to produce this binary identity. Thanks for your explanations. =E2=80=94 Christoph --Apple-Mail=_1305BF23-9668-4167-BD6F-2C41F68817B1 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCCCc0w ggSQMIIDeKADAgECAggYVYMhomAL1zANBgkqhkiG9w0BAQsFADBmMQswCQYDVQQGEwJERTEzMDEG A1UECgwqREdOIERldXRzY2hlcyBHZXN1bmRoZWl0c25ldHogU2VydmljZSBHbWJIMSIwIAYDVQQD DBlkZ25zZXJ2aWNlIENBIDIgVHlwZSBFOlBOMB4XDTIwMDUxNjE1Mjc1OVoXDTIxMDUxNjE1Mjc1 OVowbzELMAkGA1UEBhMCREUxITAfBgNVBAUTGDQwMDAwMDAwNWVjMDA4ZGQzNzNhZDhlYzEbMBkG A1UEAwwSQ2hyaXN0b3BoIEt1a3VsaWVzMSAwHgYJKoZIhvcNAQkBFhFrdWt1QGt1a3VsaWVzLm9y ZzCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAKug1655hQWRmOtGAShZLbMwDtrm7rAH 7p1oPtE/5KpTpJZe8LHPxxvW0EAd2JcLtEhdvAi7smhZ/giJ3IBK7OYmdaCvuQ6MFvJpkmLkQ9TO 4+RLW+PkBk8nFIUe+PQG+VurpWc8pbU4IRsWS3pEUgov9+LF6VtyYBHKD2HZwe46YBwUq7l0EHxc aa98ewCMO43XznlqjE+oKxwaS2nl1rL/SPVlfGmKqHkdSKEKl6yR1LCcI3J3HP56kqmIrvtySr7q UZVsibA+D6vArqklO99WKQmt0b4IX6TXouvAA6bNoF1FhYUyihm4omMWZkdTs7Gv5rr1fzPWXcev cMfJdtUCAwEAAaOCATcwggEzMB0GA1UdDgQWBBSQh9N17gCH/igJy5ftrVaJNm6SCTAMBgNVHRMB Af8EAjAAMB8GA1UdIwQYMBaAFOnGk9HVDwZkcupqlj66EPJUVLJ5MFYGA1UdIARPME0wSwYMKwYB BAH7KwIBAwIIMDswOQYIKwYBBQUHAgEWLWh0dHA6Ly9zZWM1LmRnbnNlcnZpY2UuZGUvcG9saWNp ZXMvaW5kZXguaHRtbDA+BgNVHR8ENzA1MDOgMaAvhi1odHRwOi8vc2VjNS5kZ25zZXJ2aWNlLmRl L2NybC9jcmwyLXR5cGUtZS5jcmwwDgYDVR0PAQH/BAQDAgSwMB0GA1UdJQQWMBQGCCsGAQUFBwMC BggrBgEFBQcDBDAcBgNVHREEFTATgRFrdWt1QGt1a3VsaWVzLm9yZzANBgkqhkiG9w0BAQsFAAOC AQEALUBRNzLAUiPi29LLATqWmrUlyacMVAtjdROQMd/AVPj0mUqTMoDO+YoWICOSEn/nEyb2Lrrz JNGqC6KO0CNROaWcEhFadKx4qtp9t26Qe/EkO0XbXexIfBxFl1ynQA54D0qtPb/SUZvTy0tq8oBt FdsIU+cXAzigEz2Z9nziHBMqThoKzAZSrk/sPvxT6MNMC/BMGlHGl0DV//wwI5vlzJiKS8iXFyxf 5VrN1IwgRyqXD8JsgF1BuEqcloSJ3JnWUGQCTURFasZDJlP0f/KJS8odUpEWDKnn6tt0RjBk0jUN i7z42ozzPn/o154AgXC2cNmROxC0gnvd+V/yIuAryDCCBTUwggQdoAMCAQICCFUcStdmrSX2MA0G CSqGSIb3DQEBCwUAMGExCzAJBgNVBAYTAkRFMTMwMQYDVQQKDCpER04gRGV1dHNjaGVzIEdlc3Vu ZGhlaXRzbmV0eiBTZXJ2aWNlIEdtYkgxHTAbBgNVBAMMFGRnbnNlcnZpY2UgUm9vdCA3OlBOMB4X DTE2MTAyNjA5MjI0MVoXDTI0MTAyNjA5MjI0MVowZjELMAkGA1UEBhMCREUxMzAxBgNVBAoMKkRH TiBEZXV0c2NoZXMgR2VzdW5kaGVpdHNuZXR6IFNlcnZpY2UgR21iSDEiMCAGA1UEAwwZZGduc2Vy dmljZSBDQSAyIFR5cGUgRTpQTjCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANyl8pQ/ dMejR9KXZs5ro81tFwNhloThlXe8sat79Tjjk6xFqE5E94//0vifJxMrp9RrCkNOo5oPG1djGOgk 0L0ucpHFUH9SQF/SHbm83QvWJXgqEJpjxOKZXTPbJRKVvY25niB0FTr2omRqypiP4A/w5xA6jSJ2 P02vV6WgcPfaLQkM+SEGPxV/pzpvuY3KfzJ9li9mXPNXaJD9y+jqIUvHbCAbuYKQ5nwEAcYMXDpP RQgDQGTrRiFExHEjsZeMzEFADZj9deg/h29AMO0w2YrSvkNReh/zvDZutdy25DZvjE3AUgStWgBC 7x+2ddOb2I61o6xbIsxlfq/mzNpAGoECAwEAAaOCAeowggHmMBIGA1UdEwEB/wQIMAYBAf8CAQAw HwYDVR0jBBgwFoAUAQwWG3Ry0zwU7iZ3t0kUU9j7ixswWwYIKwYBBQUHAQEETzBNMEsGCCsGAQUF BzABhj9odHRwOi8vcm9jc3AtZGduLmRnbnNlcnZpY2UuZGU6ODA4MC9lamJjYS9wdWJsaWN3ZWIv c3RhdHVzL29jc3AwagYDVR0gBGMwYTBfBgwrBgEEAfsrAgEEAgEwTzBNBggrBgEFBQcCARZBaHR0 cDovL3d3dy5kZ25zZXJ2aWNlLmRlL3RydXN0Y2VudGVyL3B1YmxpYy9kZ25zZXJ2aWNlL2luZGV4 Lmh0bWwwgZkGA1UdHwSBkTCBjjCBi6CBiKCBhYaBgmxkYXA6Ly9sZGFwLmRnbnNlcnZpY2UuZGU6 Mzg5L0NOPUNSTC0xLE89REdOJTIwU2VydmljZSUyMEdtYkgsQz1ERT9jZXJ0aWZpY2F0ZVJldm9j YXRpb25MaXN0P2Jhc2U/b2JqZWN0Q2xhc3M9Y1JMRGlzdHJpYnV0aW9uUG9pbnQwHQYDVR0OBBYE FOnGk9HVDwZkcupqlj66EPJUVLJ5MA4GA1UdDwEB/wQEAwIBBjAbBgkrBgEEAcBtAwUEDjAMBgor BgEEAcBtAwUBMA0GCSqGSIb3DQEBCwUAA4IBAQCrvDn6Rcn7/FNq3SOJNfgYNfkdR5CiGoC4sZ+i 0dypCqqMXwbpRQjSriLS2eEe2V2Fms0E4SuBOEaxOg1nVjYafQVGtytRT0ueFIzB3VcnQl7oRFJ0 SHi9d/xjElAZkk8I8lytuWG57SabA72duEp7AaCWG3lVZIdNLy+rkNrfNvEUbqUh0TrZXgqpwwCL JjYF8vyC4I+xxNaXm3EmuNvgQ2j2dGp3Oxc0QbfLLOCbK/rOdDikaBN7kTqpfHls7pcIOhQrgrPV LzY/NHqG9zEpmjuQora63YHdu7BTzGp/DvcQwfyKa/gtb9LHn3AoSUqOKOMd02sUb/AxGhsNjMzJ MYIDFDCCAxACAQEwcjBmMQswCQYDVQQGEwJERTEzMDEGA1UECgwqREdOIERldXRzY2hlcyBHZXN1 bmRoZWl0c25ldHogU2VydmljZSBHbWJIMSIwIAYDVQQDDBlkZ25zZXJ2aWNlIENBIDIgVHlwZSBF OlBOAggYVYMhomAL1zANBglghkgBZQMEAgEFAKCCAXMwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMjAxMDE4MTAxMDQ2WjAvBgkqhkiG9w0BCQQxIgQg74kvC55XlKlg HM5lTRENP5dRshpQ5uWlCp6PNj9ztIAwgYEGCSsGAQQBgjcQBDF0MHIwZjELMAkGA1UEBhMCREUx MzAxBgNVBAoMKkRHTiBEZXV0c2NoZXMgR2VzdW5kaGVpdHNuZXR6IFNlcnZpY2UgR21iSDEiMCAG A1UEAwwZZGduc2VydmljZSBDQSAyIFR5cGUgRTpQTgIIGFWDIaJgC9cwgYMGCyqGSIb3DQEJEAIL MXSgcjBmMQswCQYDVQQGEwJERTEzMDEGA1UECgwqREdOIERldXRzY2hlcyBHZXN1bmRoZWl0c25l dHogU2VydmljZSBHbWJIMSIwIAYDVQQDDBlkZ25zZXJ2aWNlIENBIDIgVHlwZSBFOlBOAggYVYMh omAL1zANBgkqhkiG9w0BAQEFAASCAQA3QnlKG5p/T8fDMwh0dHPw1zpgQMsB0JV34JEE7SMK4/nZ dOitOZLdE9Gk8HcZ/jQw3X7JGwlrOTK/yOn2dy2ItG3dbxVnrfw/PGq2KccEWz1ZVJyd30I5eK4r TOQKw1aYSfLe2zIrDl6W5bmZN4OImRhzcL58d/DC/9ID3PrTA+AMPFSaC7YTZ3j9pCu0aS7AoWVg W/xycSgWoC17+si8flyXIjq+x07IsLDNDyl8I73H4qWxO6TyRKaUAbqvW6W6NVXALR0rWuQYNEaQ hbfaCH8LQ3UjDyB/AY7iZo6x+rAFR+WQj+qSbcNy3ChLIPst3wo+LdQdkrgpwQC4qHIAAAAAAAAA --Apple-Mail=_1305BF23-9668-4167-BD6F-2C41F68817B1-- From owner-freebsd-questions@freebsd.org Sun Oct 18 11:15:14 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 39A3A42E568 for ; Sun, 18 Oct 2020 11:15:14 +0000 (UTC) (envelope-from news@mips.inka.de) Received: from mail.inka.de (mail.inka.de [IPv6:2a04:c9c7:0:1073:217:a4ff:fe3b:e77c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDck92vzJz4N6W for ; Sun, 18 Oct 2020 11:15:12 +0000 (UTC) (envelope-from news@mips.inka.de) Received: from mips.inka.de (news@[127.0.0.1]) by mail.inka.de with uucp (rmailwrap 0.5) id 1kU6eW-00A8c6-Ow; Sun, 18 Oct 2020 13:15:04 +0200 Received: from lorvorc.mips.inka.de (localhost [127.0.0.1]) by lorvorc.mips.inka.de (8.16.1/8.16.1) with ESMTP id 09IBBbBr052188 for ; Sun, 18 Oct 2020 13:11:37 +0200 (CEST) (envelope-from news@lorvorc.mips.inka.de) Received: (from news@localhost) by lorvorc.mips.inka.de (8.16.1/8.16.1/Submit) id 09IBBbNQ052187 for freebsd-questions@freebsd.org; Sun, 18 Oct 2020 13:11:37 +0200 (CEST) (envelope-from news) To: freebsd-questions@freebsd.org From: Christian Weisgerber Newsgroups: list.freebsd.questions Subject: Re: printf(1) and UTF-8 multi-byte chars Date: Sun, 18 Oct 2020 11:11:37 -0000 (UTC) Message-ID: References: <20201017191850.GA11909@c720-r342378> User-Agent: slrn/1.0.3 (FreeBSD) X-Rspamd-Queue-Id: 4CDck92vzJz4N6W X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of news@mips.inka.de has no SPF policy when checking 2a04:c9c7:0:1073:217:a4ff:fe3b:e77c) smtp.mailfrom=news@mips.inka.de X-Spamd-Result: default: False [1.53 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[news]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[inka.de]; NEURAL_SPAM_MEDIUM(0.23)[0.233]; NEURAL_SPAM_LONG(0.47)[0.466]; NEURAL_HAM_SHORT(-0.37)[-0.365]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[naddy@mips.inka.de,news@mips.inka.de]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:202113, ipnet:2a04:c9c7::/32, country:DE]; FROM_NEQ_ENVFROM(0.00)[naddy@mips.inka.de,news@mips.inka.de]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 11:15:14 -0000 On 2020-10-17, Matthias Apitz wrote: > This means the output of printf(1) is byte oriented and not > character oriented. This conforms to POSIX. -- Christian "naddy" Weisgerber naddy@mips.inka.de From owner-freebsd-questions@freebsd.org Sun Oct 18 13:43:50 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4B7F1432F19 for ; Sun, 18 Oct 2020 13:43:50 +0000 (UTC) (envelope-from lumiwa@dismail.de) Received: from mx1.dismail.de (mx1.dismail.de [78.46.223.134]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mx1.dismail.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDh1c6jnJz4VFD for ; Sun, 18 Oct 2020 13:43:48 +0000 (UTC) (envelope-from lumiwa@dismail.de) Received: from mx1.dismail.de (localhost [127.0.0.1]) by mx1.dismail.de (OpenSMTPD) with ESMTP id b89c861e for ; Sun, 18 Oct 2020 15:43:46 +0200 (CEST) Received: from smtp2.dismail.de ( [10.240.26.12]) by mx1.dismail.de (OpenSMTPD) with ESMTP id 4ac1b890 for ; Sun, 18 Oct 2020 15:43:45 +0200 (CEST) Received: from smtp2.dismail.de (localhost [127.0.0.1]) by smtp2.dismail.de (OpenSMTPD) with ESMTP id 49dcba66 for ; Sun, 18 Oct 2020 15:43:45 +0200 (CEST) Received: by dismail.de (OpenSMTPD) with ESMTPSA id 6930b01d (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO) for ; Sun, 18 Oct 2020 15:43:45 +0200 (CEST) Date: Sun, 18 Oct 2020 09:43:38 -0400 From: LuMiWa To: FreeBSD Questions Subject: binary type "0" not known. Message-ID: <20201018094338.3c72602f@dismail.de> X-Mailer: Claws Mail 3.17.5 (GTK+ 2.24.32; amd64-portbld-freebsd12.1) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4CDh1c6jnJz4VFD X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.67 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.028]; R_DKIM_ALLOW(-0.20)[dismail.de:s=20190914]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[dismail.de:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:78.46.223.134]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.976]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[78.46.223.134:from]; DKIM_TRACE(0.00)[dismail.de:+]; DMARC_POLICY_ALLOW(-0.50)[dismail.de,reject]; NEURAL_HAM_SHORT(-0.97)[-0.967]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:78.46.0.0/15, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 13:43:50 -0000 Hi! I am running FreeBSD 12.1-RELEASE-p10 (amd64) and I do not have Linux installed. When I check my system with lib_chk It found two 'times binary type "0" not known.'. I do not know why.=20 In /sys/compat are directoris /linux and /linuxkpi which are not empty and in /usr/local/include ins also /linux which is not empty. Thank you. --=20 =E2=80=9CThe secret of happiness, you see is not found in seeking more, but= in developing the capacity to enjoy less.=E2=80=9D =E2=80=94 Socrates=20 From owner-freebsd-questions@freebsd.org Sun Oct 18 15:48:46 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E15E6435739 for ; Sun, 18 Oct 2020 15:48:46 +0000 (UTC) (envelope-from johnl@iecc.com) Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gal.iecc.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDknn5rZmz4dSt for ; Sun, 18 Oct 2020 15:48:45 +0000 (UTC) (envelope-from johnl@iecc.com) Received: (qmail 30054 invoked from network); 18 Oct 2020 15:48:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding; s=7563.5f8c63d7.k2010; bh=67jChVfgn6lqQivZeKUSC0THKCVOSM1rVGxlYbjGpDI=; b=L+EbSRx2LbzRrPbOsaFb9wpGGv0zneL+XgURFfOwL2fEwkijq/OGVvkalAb+KZ0DObLb86exJKINMIRDu7Dm3a5e1Go84WkqJXG0D+lxhcWnfeJqcR2E9QxrKJAoFgx2stpi4ZNqYJPPW9c2VFaC5+0pK7NHqKji7tIjvFXg/h+SBXgbp4sRaFWAUsrIDBoCzkK7pyP7f6zVw181v3xp17DnH4yH2XxJHgGewi4hxGKfuW6J4PxYIbP/DGrMvqmKmGpPdjM7Z9h3382dgrCPHIHt83Vf3D2fpcfxbEKHw90IcBhK+tSgh1ZiRsD+QUbqqqlYIP0jekJw1lYHQCR8Lg== Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 18 Oct 2020 15:48:38 -0000 Received: by ary.qy (Postfix, from userid 501) id 49CBC239CEDF; Sun, 18 Oct 2020 11:48:37 -0400 (EDT) Date: 18 Oct 2020 11:48:37 -0400 Message-Id: <20201018154838.49CBC239CEDF@ary.qy> From: "John Levine" To: freebsd-questions@freebsd.org Cc: naddy@mips.inka.de Subject: Re: printf(1) and UTF-8 multi-byte chars In-Reply-To: Organization: Taughannock Networks X-Headerized: yes Mime-Version: 1.0 Content-type: text/plain; charset=utf-8 Content-transfer-encoding: 8bit X-Rspamd-Queue-Id: 4CDknn5rZmz4dSt X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=iecc.com header.s=7563.5f8c63d7.k2010 header.b=L+EbSRx2; dmarc=pass (policy=none) header.from=iecc.com; spf=pass (mx1.freebsd.org: domain of johnl@iecc.com designates 2001:470:1f07:1126:0:43:6f73:7461 as permitted sender) smtp.mailfrom=johnl@iecc.com X-Spamd-Result: default: False [-4.85 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[iecc.com:s=7563.5f8c63d7.k2010]; NEURAL_HAM_MEDIUM(-0.96)[-0.955]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[iecc.com:dkim]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f07:1126::/64]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.966]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[iecc.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[iecc.com,none]; NEURAL_HAM_SHORT(-0.43)[-0.432]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 15:48:46 -0000 In article you write: >On 2020-10-17, Matthias Apitz wrote: > >> This means the output of printf(1) is byte oriented and not >> character oriented. > >This conforms to POSIX. I don't think there is any useful middle ground between counting bytes and full Unicode typesetting. Some Unicode characters are half- or double-width, particularly in east Asian languages, and many combine with adjacent characters depending on context, e.g., the character ö can be the single xF6 character which is two UTF-8 bytes, or a combining diaresis x308 followed by lower case o x6F which is three UTF-8 bytes, but one space wide either way. From owner-freebsd-questions@freebsd.org Sun Oct 18 17:23:15 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9BE63437985 for ; Sun, 18 Oct 2020 17:23:15 +0000 (UTC) (envelope-from 4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDmtp3J9yz4kDy for ; Sun, 18 Oct 2020 17:23:14 +0000 (UTC) (envelope-from 4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com) DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1603041792; x=1605633792; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:cc:to:from:date:x-thread-info; bh=dn6346QVEK0jbaBO19EVM+SbSTM8ge9p9WQBoZtgouM=; b=L4/w++D1oj4QraG7/bvh1ToD5SN9uIjBUFTNV8VUN16S95mW+PvJtjuBHNkWBDvaMWsPgoxaWmgBM5DzyWjAVi0UHtEOn3TK+dl0QIfBk2byzLM6FVdCn2BgFG7jbnTHwvIsfd5jW7Jr824p5frDWNUydmfoOp9nfwEjc132kbQ= X-Thread-Info: NDI1MC45Mi4xZDRjNTAwMDNmZjBiMGUuZnJlZWJzZC1xdWVzdGlvbnM9ZnJlZWJzZC5vcmc= Received: from r2.h.in.socketlabs.com (r2.h.in.socketlabs.com [142.0.180.12]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sun, 18 Oct 2020 13:23:10 -0400 Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r2.h.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sun, 18 Oct 2020 13:23:11 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.94 (FreeBSD)) (envelope-from ) id 1kUCOj-000G9T-Sp; Sun, 18 Oct 2020 18:23:10 +0100 Date: Sun, 18 Oct 2020 18:23:09 +0100 From: Steve O'Hara-Smith To: "John Levine" Cc: freebsd-questions@freebsd.org, naddy@mips.inka.de Subject: Re: printf(1) and UTF-8 multi-byte chars Message-Id: <20201018182309.490ff752536eae2092533c5a@sohara.org> In-Reply-To: <20201018154838.49CBC239CEDF@ary.qy> References: <20201018154838.49CBC239CEDF@ary.qy> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) X-Clacks-Overhead: "GNU Terry Pratchett" Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CDmtp3J9yz4kDy X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=L4/w++D1; dmarc=none; spf=pass (mx1.freebsd.org: domain of 4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com X-Spamd-Result: default: False [-2.92 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; NEURAL_HAM_MEDIUM(-0.94)[-0.936]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sohara.org]; NEURAL_HAM_LONG(-0.96)[-0.959]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[email-od.com:+]; NEURAL_HAM_SHORT(-1.32)[-1.320]; RCVD_IN_DNSWL_NONE(0.00)[142.0.176.198:from]; RWL_MAILSPIKE_GOOD(0.00)[142.0.176.198:from]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d4c50003ff0b0e.56e421c9d8dfc37b0bd5c5a082e6bb6b@email-od.com]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 17:23:15 -0000 On 18 Oct 2020 11:48:37 -0400 "John Levine" wrote: > I don't think there is any useful middle ground between counting bytes > and full Unicode typesetting. There are good reasons for using all three levels, here are some: Bytes: Content length headers, malloc calls - storage related Glyphs: Truncation, apparent length, sorting - appearance related Unicode Characters: UTF-8/16/32 conversions - encoding related -- Steve O'Hara-Smith From owner-freebsd-questions@freebsd.org Sun Oct 18 18:05:49 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7EFD84386A7 for ; Sun, 18 Oct 2020 18:05:49 +0000 (UTC) (envelope-from johnl@iecc.com) Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gal.iecc.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDnqw1Vf6z4mHj for ; Sun, 18 Oct 2020 18:05:47 +0000 (UTC) (envelope-from johnl@iecc.com) Received: (qmail 50194 invoked from network); 18 Oct 2020 18:05:46 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:references:mime-version:content-type; s=c410.5f8c83fa.k2010; i=johnl-iecc.com@submit.iecc.com; bh=WR8yd3gRLOgnHFRURiw0fEmg2h6B/lvqgjllHbcdG/0=; b=Wd53auyC8ryr06b2ZJsSiGE3yQgWF9onQaKOM8ULcqk2ko9DRLNq63aJxWCeiKx6pPrvUKhPD4VBXVAcjGkbDGJS9gVQUnRGbZ4prriKDreZXLumgG3na3eLqDUyyHFtszoKdUzH1YQmsBGMd25+d2T2UsXJNWyvLst43914jrzWGBVTbG4b8dnOmqohyeEc/TMOqnhmrmKZCvkyUrOA71i2C6oZcGQSj2VowIpuSg5ZXl4NyHjNBw+nOlx9OGdG6jQVPLVHdmtylImJ8vlpkwN4gwtTRAeHnSFRvMhyk9Jfn/PI1utPsANLYMH6jgVnixctrPPUkanhflG02U+66w== Received: from localhost ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPSA (TLS1.3 ECDHE-RSA AES-256-GCM AEAD, johnl@iecc.com) via TCP6; 18 Oct 2020 18:05:46 -0000 Date: 18 Oct 2020 14:05:46 -0400 Message-ID: <3c62a326-887f-4f4e-dbb2-56666f7571a0@iecc.com> From: "John R. Levine" To: "Steve O'Hara-Smith" Cc: freebsd-questions@freebsd.org, naddy@mips.inka.de Subject: Re: printf(1) and UTF-8 multi-byte chars In-Reply-To: <20201018182309.490ff752536eae2092533c5a@sohara.org> References: <20201018154838.49CBC239CEDF@ary.qy> <20201018182309.490ff752536eae2092533c5a@sohara.org> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4CDnqw1Vf6z4mHj X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=iecc.com header.s=c410.5f8c83fa.k2010 header.b=Wd53auyC; dmarc=pass (policy=none) header.from=iecc.com; spf=pass (mx1.freebsd.org: domain of johnl@iecc.com designates 2001:470:1f07:1126:0:43:6f73:7461 as permitted sender) smtp.mailfrom=johnl@iecc.com X-Spamd-Result: default: False [-5.60 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[iecc.com:s=c410.5f8c83fa.k2010]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f07:1126::/64]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; DWL_DNSWL_MED(-2.00)[iecc.com:dkim]; NEURAL_HAM_LONG(-0.96)[-0.962]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[iecc.com:+]; DMARC_POLICY_ALLOW(-0.50)[iecc.com,none]; NEURAL_HAM_SHORT(-0.67)[-0.673]; NEURAL_HAM_MEDIUM(-0.96)[-0.963]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 18:05:49 -0000 > There are good reasons for using all three levels, here are some: > > Bytes: Content length headers, malloc calls - storage related Sure. > Glyphs: Truncation, apparent length, sorting - appearance related Not so much. I suppose it's preferable to truncate at a glyph boundary, but sorting UTF-8 bytes gives you the same order as sorting the glyphs, and for useful sorting you need to deal with issues like normalized forms and case folding. Not sure what use apparent length would be since the number of glyphs tells you neither the number of visible characters nor how wide they are. > Unicode Characters: UTF-8/16/32 conversions - encoding related That and a lot of composition and display issues. Regards, John Levine, johnl@taugh.com, Primary Perpetrator of "The Internet for Dummies", Please consider the environment before reading this e-mail. https://jl.ly From owner-freebsd-questions@freebsd.org Sun Oct 18 19:15:25 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 257424398A3 for ; Sun, 18 Oct 2020 19:15:25 +0000 (UTC) (envelope-from woodbrian77@gmail.com) Received: from mail-io1-xd33.google.com (mail-io1-xd33.google.com [IPv6:2607:f8b0:4864:20::d33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDqNC5xr5z4prl for ; Sun, 18 Oct 2020 19:15:23 +0000 (UTC) (envelope-from woodbrian77@gmail.com) Received: by mail-io1-xd33.google.com with SMTP id k21so10457077ioa.9 for ; Sun, 18 Oct 2020 12:15:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=7KW8F7tyCS1HxKoKeH6q+AIQMG+lVNRB3ajnG/kcdHs=; b=MuVTWtIc7vRCoYjlXJDjevZuaSNojPywY+vVPg/W/8o2hze8Fefw8z1JiJnRlTv0KL 7hWMYEFY9Ji1QqUE0XZNdKnP5dM6/9Fpf8r3DVKb9XpE/KSmAgmdqAW8U9Nmgg6oTLu5 CMzymx/Zlqb6FrfLPwqyEPpnrJonH9972cpm7x3kJ/BCnbCfYBvSwkt7vKAlx+8GnGqY FVhEygUeuNfD1CcNrUYsO3CE23yBz7CN6gYOH+Tq1++Yx/dFY5GEpL+Jlrbz5KjLNNr0 ygxNQaULAeKeCRGfFSLLTWXkmQ4Pmg2pzLJGegW4uQR/QP692h2+5TdAiIYvxiOBbIJC 8ejg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=7KW8F7tyCS1HxKoKeH6q+AIQMG+lVNRB3ajnG/kcdHs=; b=fkjxfyk4IxWwkQDWQXaBa+lxaBRsqza4RaEuHeIEYcenxAMKaaxy7ueUuzVtg9LyQO truuGVfJ8LTri7oYvIX6/KX2uEQCpAskohMrWVvoB8C3+aHFitty7hr6UesX7cggHhtX Bedj2E4x7vsloZET9ld/cJRM4JGTZbp1+QGEGFDpunvuCdGhMNq3m1YqqBfUj3DbEhUW G35aZIMwbfeTfVtrLi38Z8H0XB10dCc1kMkO23ugE3786WzreazOD7kohSf467mthtfm xiOKZUV52xy6xjOrnk8SVXj7v5KALXmhQKJs4y8Uv4X3V3+ja+jt95zcmtYkQ7f9jXHw rtEg== X-Gm-Message-State: AOAM532qDzAdcy113F4Ubz2H+ZuXI9JBu1D6/uU9DDEGstetC7LSCThg eNntedPaeldR9k+8OhR/NDzzEYGR3c/Fc9thHHYX+v3bRO4= X-Google-Smtp-Source: ABdhPJyA/ycq9CYH/DbXTkUHiqLyJFFuur/EzGs5GQhnpcYJPxDJaDOD6zB4QNJCRswpiTaRMN2AJTpJIf9bQjHEYLg= X-Received: by 2002:a6b:9243:: with SMTP id u64mr8266610iod.197.1603048522368; Sun, 18 Oct 2020 12:15:22 -0700 (PDT) MIME-Version: 1.0 From: Brian Wood Date: Sun, 18 Oct 2020 14:15:11 -0500 Message-ID: Subject: Users needed To: FreeBSD Questions X-Rspamd-Queue-Id: 4CDqNC5xr5z4prl X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=MuVTWtIc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of woodbrian77@gmail.com designates 2607:f8b0:4864:20::d33 as permitted sender) smtp.mailfrom=woodbrian77@gmail.com X-Spamd-Result: default: False [-1.13 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.968]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d33:from]; NEURAL_HAM_SHORT(-0.16)[-0.161]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions]; HTTP_TO_HTTPS(2.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 19:15:25 -0000 Shalom I'm looking for someone interested in using my C++ messaging and serialization library: https://github.com/Ebenezer-group/onwards . I'll spend 16 hours/week for six months on your project if we use my software as part of the project. More info here: https://webEbenezer.net/about.html . My approach consists of three programs and a library. Two of the programs and the library are in the repository. The third program is closed source and runs on FreeBSD. Brian Ebenezer Enterprises - Enjoying programming again. https://webEbenezer.net From owner-freebsd-questions@freebsd.org Sun Oct 18 20:38:05 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F3E1B43B07B for ; Sun, 18 Oct 2020 20:38:05 +0000 (UTC) (envelope-from bob@proulx.com) Received: from havoc.proulx.com (havoc.proulx.com [96.88.95.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDsCc4fwPz4vds for ; Sun, 18 Oct 2020 20:38:04 +0000 (UTC) (envelope-from bob@proulx.com) Received: from joseki.proulx.com (localhost [127.0.0.1]) by havoc.proulx.com (Postfix) with ESMTP id 96F385C4 for ; Sun, 18 Oct 2020 14:37:56 -0600 (MDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proulx.com; s=dkim2048; t=1603053476; bh=yRA/IIZ+6RAHBRF66VVWWN7guuRDV1CgpOonTDxsuQw=; h=Date:From:To:Subject:References:In-Reply-To:From; b=q+LSwCkdV0Te9A5y9UtzCFMLwtyHDu0pt+Nx0JKHaGCt9AG10QfXmQ0UL81kkt9JY gnVj+FwK3oMu5B0zWBwqZrKhBxgY4OXvaccoWoR8xdAIib33rT9evMoXh0mTWP6vR7 uLfg1rcoaXv77sT01lBk4HyL7aSCUVWKKf8YZixpDJwb039rEenG/6+CiEl7f3L4Wq s8eTTQ01ANSdE4eGOhvPbz66yZk84FBgTO6Ywh/xfGYDDlhGRSS6V7aCI/Mt+yPYAD X1643POjUAuMBiU0mVALfoer6/LFlAogQq4lzm/hnTETJiAOAdvP+0K6QD6vkNDj+W 45pEE8CZP3GHA== Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id 712A321144 for ; Sun, 18 Oct 2020 14:37:56 -0600 (MDT) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 3AD222DC9D; Sun, 18 Oct 2020 14:37:56 -0600 (MDT) Date: Sun, 18 Oct 2020 14:37:55 -0600 From: Bob Proulx To: freebsd-questions@freebsd.org Subject: Re: sh scripting question Message-ID: <20201018141345096243637@bob.proulx.com> References: <24456.60388.135834.43951@jerusalem.litteratus.org> <20201015204226099763897@bob.proulx.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4CDsCc4fwPz4vds X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proulx.com header.s=dkim2048 header.b=q+LSwCkd; dmarc=pass (policy=none) header.from=proulx.com; spf=pass (mx1.freebsd.org: domain of bob@proulx.com designates 96.88.95.61 as permitted sender) smtp.mailfrom=bob@proulx.com X-Spamd-Result: default: False [-3.57 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.05)[-1.055]; R_DKIM_ALLOW(-0.20)[proulx.com:s=dkim2048]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.980]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[proulx.com:+]; DMARC_POLICY_ALLOW(-0.50)[proulx.com,none]; NEURAL_HAM_SHORT(-0.53)[-0.533]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:7922, ipnet:96.64.0.0/11, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 20:38:06 -0000 Kurt Hackenberg wrote: > Bob Proulx wrote: > > > Oh you are tormenting us now. :-) There are some subtle issues here. > > Maybe a shell is the wrong tool. And yet just the same the shell does handle whitespace and arbitrary characters in file names easily. while IFS= read -r line; do printf "|%s|\n" "$line" done < file1 It's a shell programming idiom. It accomplishes the task very easily. For people programming in the shell every day this type of construct rolls off the fingers like a native language. But it may not be immediately obvious without a hint that this is what is needed. Idiom, id-ee-uhm, noun. An expression conforming or appropriate to the peculiar structural form of a language. Nothing we have seen yet makes the shell the wrong tool. The shell is a very powerful command and control language. And so far the original need was still for using it specifically as a command and control language. So all good so far! If we move to needing complex data structures however that is where my decision point is set to move to a language that supports complex data types. And I think everyone is in agreement that the filenames that were chosen were not the file names that any Unix person would choose to name their files. No disagreement there. I am sure they were chosen by less enlightened individuals. Given that the files on disk were chosen for a different purpose then can we handle them easily in the shell? Yes. So far nothing too difficult! :-) Bob From owner-freebsd-questions@freebsd.org Sun Oct 18 21:44:24 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3732F43D252 for ; Sun, 18 Oct 2020 21:44:24 +0000 (UTC) (envelope-from bob@proulx.com) Received: from havoc.proulx.com (havoc.proulx.com [96.88.95.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDth653LLz3WXy for ; Sun, 18 Oct 2020 21:44:22 +0000 (UTC) (envelope-from bob@proulx.com) Received: from joseki.proulx.com (localhost [127.0.0.1]) by havoc.proulx.com (Postfix) with ESMTP id CDDAC5E9 for ; Sun, 18 Oct 2020 15:44:20 -0600 (MDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proulx.com; s=dkim2048; t=1603057460; bh=tGolCSiwdkcyLJ3ffoHDNT5v5qa8Lnf/5q/pozXRl7g=; h=Date:From:To:Subject:References:In-Reply-To:From; b=h0Z/jebKOozfOhLPLFENeB0i4NOBAFAUTO2cArjez7zC4JAOMbUkLQ8+X88iGPmpt Hrj+cxEvyPmJg8sIms1UEGFJbP3mGlIo2W6THSpq1CJoiRN1F628cM41KjlPFCW/ap mbllSrFE1C6WFps17zO/wSG4+uhGBR7fbNDRxT6+uz4tIhsJ35o9V3OXuHQUnFCIKi 1JhmY9y/Wq4CC7rF48mWeu29sTlGCQuITW7+nVvWM9q8dF6aYE7YqxkiaMTELr1fTC clmf0oE+/TpW7cTzAIhNsEPqDpFYLZDW/uAUmfVrxM2ZAhMYNlmWlI2xbbzV6nZIty jxfIJMVTu8Gbw== Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id 99FF821157 for ; Sun, 18 Oct 2020 15:44:20 -0600 (MDT) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 6DBD82DC9D; Sun, 18 Oct 2020 15:44:20 -0600 (MDT) Date: Sun, 18 Oct 2020 15:44:20 -0600 From: Bob Proulx To: freebsd-questions@freebsd.org Subject: Re: sh scripting question Message-ID: <20201018144327254822114@bob.proulx.com> References: <20201016113408.16d58d68@archlinux> <24457.35680.223661.203846@jerusalem.litteratus.org> <444kmtudmy.fsf@be-well.ilk.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <444kmtudmy.fsf@be-well.ilk.org> X-Rspamd-Queue-Id: 4CDth653LLz3WXy X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proulx.com header.s=dkim2048 header.b=h0Z/jebK; dmarc=pass (policy=none) header.from=proulx.com; spf=pass (mx1.freebsd.org: domain of bob@proulx.com designates 96.88.95.61 as permitted sender) smtp.mailfrom=bob@proulx.com X-Spamd-Result: default: False [-3.58 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.06)[-1.062]; R_DKIM_ALLOW(-0.20)[proulx.com:s=dkim2048]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.981]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[proulx.com:+]; DMARC_POLICY_ALLOW(-0.50)[proulx.com,none]; NEURAL_HAM_SHORT(-0.54)[-0.537]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:7922, ipnet:96.64.0.0/11, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 21:44:24 -0000 Lowell Gilbert wrote: > Robert Huff writes: > > OP here. > > The filenames at hand were generated by "find" and - on casual > > inspection - have no oddities other than the embedded spaces. > > Since find is in use, I think the canonical solution is > to use "find -print0"..."xargs -0" Since GNU find introduced -print0 and xargs -0 that at one time was the Best Practice since that combination handled arbitrary file names as efficiently as was available at the time. However since then find now provides an even better way! Plus it is now a POSIX standard and therefore a POSIX portable scripting way too. Here is an example, I will use a "ls -ld" command just to make it a real concrete example and perhaps easier to read that way. find . -exec ls -ld {} + In this there is no need for xargs as find can do it all itself internally. There is no need for -print0 since there is no communication to another process needed. -exec utility [argument ...] {} + Same as -exec, except that “{}” is replaced with as many pathnames as possible for each invocation of utility. This behaviour is similar to that of xargs(1). The primary always returns true; if at least one invocation of utility returns a non-zero exit status, find will return a non-zero exit status. For the advocates of -execdir I will mention it here so that they know I am aware of it too. :-) And since we are talking about whitespace and arbitrary shell meta-characters here is an example to show that there is no problem with them when using find in this way. rwp@outrage:~$ mkdir /tmp/junk rwp@outrage:~$ cd /tmp/junk rwp@outrage:/tmp/junk$ touch " \" \" \" \";.txt \"" rwp@outrage:/tmp/junk$ find . -type f -exec ls -ld {} + -rw-r--r-- 1 rwp wheel 0 Oct 18 14:57 ./ " " " ";.txt " And now it is time to show off how good 'find' can be, even if it is an even more obscure example. But it is another useful shell programming idiom and good to know about. Since find can invoke any arbitrary command with quoted arguments as needed. rwp@outrage:/tmp/junk$ find . -type f -exec sh -c 'ls -ld "$@"' sh {} + -rw-r--r-- 1 rwp wheel 0 Oct 18 14:57 ./ " " " ";.txt " Any external program utility that can be called from the command line can be called arbitrarily with all of the proper quoting in place. In the above we invoke the standard shell with "sh -c" and pass it a list of arguments with "{} +". In the script itself we use "$@" to ensure that the shell (the sh -c part) quoted each argument correctly to pass it to the command. In this case the command was my example use of "ls -ld". And that leaves us with the mystery of the second "sh" on the line which is due to the use of "sh -c". It's the command process name and required when passing arguments to "sh -c". > But it's not always convenient to use that mechanism, so > there are other methods that have been used quite a few > times, depending on the tools the user is comfortable > with. In my case, it might involve an inline sed > invocation to add the quoting for the spaces. Being comfortable with the tools on the workbench is important. Those are the tools that will get used. If they get the job done then whatever the user is most comfortable with is okay. But if one is wishing to improve their skills then learning something new every so often is even better! :-) Bob P.S. Here is a longer description of the command name argument when using "sh -c". The "man sh" docs on FreeBSD only say this. sh [-/+abCEefhIimnPpTuVvx] [-/+o longname] -c string [name [arg ...]] It's the "name" field in that synopsis. However the rest of the man page for sh for -c is less than great since it does not go into the detail needed. The -c option causes the commands to be read from the string operand instead of from the standard input. Keep in mind that this option only accepts a single string as its argument, hence multi-word strings must be quoted. That's sad. Missing the description of "name" there. The bash manual does a better job of this description in the bash manual. -c If the -c option is present, then commands are read from the first non-option argument command_string. If there are arguments after the command_string, the first argument is assigned to $0 and any remaining arguments are assigned to the positional parameters. The assignment to $0 sets the name of the shell, which is used in warning and error messages. And this is backed up by the online standards. https://pubs.opengroup.org/onlinepubs/9699919799/utilities/sh.html sh -c [-abCefhimnuvx] [-o option]... [+abCefhimnuvx] [+o option]... command_string [command_name [argument...]] -c Read commands from the command_string operand. Set the value of special parameter 0 (see Special Parameters) from the value of the command_name operand and the positional parameters ($1, $2, and so on) in sequence from the remaining argument operands. When using sh -c the first argument should be the name to assign to the process, argv[0], and subsequent arguments are the actual arguments. So with sh -c one always needs to specify the process name. And if not then the first actual argument is lost. And so that is yet another shell idiom. rwp@outrage:/tmp/junk$ sh -c 'echo "$@"' one two three two three rwp@outrage:/tmp/junk$ sh -c 'echo "$@"' sh one two three one two three rwp@outrage:/tmp/junk$ sh -c 'echo arg0="$0" "$@"' one two three arg0=one two three And so when using sh -c we always give it the process name as the first argument. Hence the use of "sh" before the "{} +" when using it with the find utility. From owner-freebsd-questions@freebsd.org Sun Oct 18 21:54:25 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B851E43D887 for ; Sun, 18 Oct 2020 21:54:25 +0000 (UTC) (envelope-from johnl@iecc.com) Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gal.iecc.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDtvg6LP0z3WgG for ; Sun, 18 Oct 2020 21:54:23 +0000 (UTC) (envelope-from johnl@iecc.com) Received: (qmail 86367 invoked from network); 18 Oct 2020 21:54:22 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding; s=1515d.5f8cb98e.k2010; bh=mkYWk+MjWz8gpl0LMP0FHKD+X8cQQRGSkw6IMUg03Fk=; b=o3nNGOzpBH94EsaBjy2VbFoUZQPKzvB9RbyR+6ofGNfsPtgbTWu96cdqyiVYilmJYUTtKK8Z2dSf+EovNyeq4/qEEHO4PRWdLMgB/8LsDbObX3uOhbuIA8Lm6zixYdVPFKm0vLxe/pJ6tuS9y33EddTf0q9LRequxwo/vvzLn7PP+0Q8HzGB+MV2/UaahBh44j/qdJv88EKRE4XHEGKNh+TxEvuN1ceX+FUPS0rAcuVCIJy5oRx79H7btrbCBonTIcS0nzibBfIP3FI7zsFQ280zWHqMPihCsmnR8Mnf3J239emEKnESlPTSHb3EIPdMKuBP0vj/vNk7bzwn8dOASw== Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 18 Oct 2020 21:54:21 -0000 Received: by ary.qy (Postfix, from userid 501) id 6BA9B23A1462; Sun, 18 Oct 2020 17:54:20 -0400 (EDT) Date: 18 Oct 2020 17:54:20 -0400 Message-Id: <20201018215421.6BA9B23A1462@ary.qy> From: "John Levine" To: freebsd-questions@freebsd.org Cc: bob@proulx.com Subject: Re: sh scripting question In-Reply-To: <20201018144327254822114@bob.proulx.com> Organization: Taughannock Networks X-Headerized: yes Mime-Version: 1.0 Content-type: text/plain; charset=utf-8 Content-transfer-encoding: 8bit X-Rspamd-Queue-Id: 4CDtvg6LP0z3WgG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=iecc.com header.s=1515d.5f8cb98e.k2010 header.b=o3nNGOzp; dmarc=pass (policy=none) header.from=iecc.com; spf=pass (mx1.freebsd.org: domain of johnl@iecc.com designates 2001:470:1f07:1126:0:43:6f73:7461 as permitted sender) smtp.mailfrom=johnl@iecc.com X-Spamd-Result: default: False [-4.66 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[iecc.com:s=1515d.5f8cb98e.k2010]; NEURAL_HAM_MEDIUM(-1.09)[-1.094]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[iecc.com:dkim]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f07:1126::/64]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.966]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[iecc.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[iecc.com,none]; NEURAL_HAM_SHORT(-0.11)[-0.106]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 21:54:25 -0000 In article <20201018144327254822114@bob.proulx.com> you write: >> Since find is in use, I think the canonical solution is >> to use "find -print0"..."xargs -0" >Here is an example, I will use a "ls -ld" command just to make it a >real concrete example and perhaps easier to read that way. > > find . -exec ls -ld {} + Sometimes that's better, sometimes not. I have find scripts that delete stale files, and it is a lot faster to use xargs to run "rm" once for each thousand files than once per file. -- Regards, John Levine, johnl@taugh.com, Primary Perpetrator of "The Internet for Dummies", Please consider the environment before reading this e-mail. https://jl.ly From owner-freebsd-questions@freebsd.org Sun Oct 18 22:24:24 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1881B43E01A for ; Sun, 18 Oct 2020 22:24:24 +0000 (UTC) (envelope-from bob@proulx.com) Received: from havoc.proulx.com (havoc.proulx.com [96.88.95.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDvZH2LVFz3Xbj for ; Sun, 18 Oct 2020 22:24:23 +0000 (UTC) (envelope-from bob@proulx.com) Received: from joseki.proulx.com (localhost [127.0.0.1]) by havoc.proulx.com (Postfix) with ESMTP id B6D4A6BF for ; Sun, 18 Oct 2020 16:24:21 -0600 (MDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proulx.com; s=dkim2048; t=1603059861; bh=PBlhbqt42MX4dcznCH2T8cEyCuX2TB5IB7JyH7ocPuM=; h=Date:From:To:Subject:References:In-Reply-To:From; b=dexALBGuLYL62ZKmA3lK2PBIuKGuxJQwl8hVQj2W7m0Pf6cjy5Lh3cw9JQv8P/MyJ 9NWv8FdRPwdHFPgKha7V0DcNdLaESPy9dqzS51v34oCg32wqrHPgyIRJ1EQ4i2hJKo gITJGsMHrRhMLazS7Krh+snGFPOGK8iPYgF21XtzAZ4u1tvcN54j5VwoAJ5QWpYGjG qGN9xf8dC/RoloWO+nQTuhBeajz4MZvdG1BHLz6z20vIF0++AN1K8wnopqVVgZOgfR MlUxls1dEgVA8QQnPotsA8k1U8ihe0DMZbYXc1nrTPgHlNBfgjqnK2rD3NRNqtFUqE oKEUZMtizMZ0g== Received: from hysteria.proulx.com (hysteria.proulx.com [192.168.230.119]) by joseki.proulx.com (Postfix) with ESMTP id 678812112F for ; Sun, 18 Oct 2020 16:24:21 -0600 (MDT) Received: by hysteria.proulx.com (Postfix, from userid 1000) id 51CDC2DC9D; Sun, 18 Oct 2020 16:24:21 -0600 (MDT) Date: Sun, 18 Oct 2020 16:24:21 -0600 From: Bob Proulx To: freebsd-questions@freebsd.org Subject: Re: sh scripting question Message-ID: <20201018155812796938832@bob.proulx.com> References: <20201018144327254822114@bob.proulx.com> <20201018215421.6BA9B23A1462@ary.qy> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20201018215421.6BA9B23A1462@ary.qy> X-Rspamd-Queue-Id: 4CDvZH2LVFz3Xbj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proulx.com header.s=dkim2048 header.b=dexALBGu; dmarc=pass (policy=none) header.from=proulx.com; spf=pass (mx1.freebsd.org: domain of bob@proulx.com designates 96.88.95.61 as permitted sender) smtp.mailfrom=bob@proulx.com X-Spamd-Result: default: False [-3.58 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.06)[-1.061]; R_DKIM_ALLOW(-0.20)[proulx.com:s=dkim2048]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.981]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[proulx.com:+]; DMARC_POLICY_ALLOW(-0.50)[proulx.com,none]; NEURAL_HAM_SHORT(-0.54)[-0.535]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:7922, ipnet:96.64.0.0/11, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2020 22:24:24 -0000 John Levine wrote: > In article <20201018144327254822114@bob.proulx.com> you write: > >> Since find is in use, I think the canonical solution is > >> to use "find -print0"..."xargs -0" > > >Here is an example, I will use a "ls -ld" command just to make it a > >real concrete example and perhaps easier to read that way. > > > > find . -exec ls -ld {} + > > Sometimes that's better, sometimes not. I have find scripts that delete > stale files, and it is a lot faster to use xargs to run "rm" once for > each thousand files than once per file. Ah! Not quite. Let me explain. Since when using "{} +" it only invokes the command *once* not multiple times. "{} \;" invokes the command once per argument. But "{} +" invokes the command with as many arguments as possible to fit within ARG_MAX (if arg_max is a limitation, it is kernel dependent). On systems with ARG_MAX as the limitation then if the argument list would overflow ARG_MAX then the command will be invoked multiple times. Otherwise only once. The find manual says this about the two cases. -exec utility [argument ...] ; True if the program named utility returns a zero value as its exit status. Optional arguments may be passed to the utility. The expression must be terminated by a semicolon (“;”). If you invoke find from a shell you may need to quote the semicolon if the shell would otherwise treat it as a control operator. If the string “{}” appears anywhere in the utility name or the arguments it is replaced by the pathname of the current file. Utility will be executed from the directory from which find was executed. Utility and arguments are not subject to the further expansion of shell patterns and constructs. -exec utility [argument ...] {} + Same as -exec, except that “{}” is replaced with as many pathnames as possible for each invocation of utility. This behaviour is similar to that of xargs(1). The primary always returns true; if at least one invocation of utility returns a non-zero exit status, find will return a non-zero exit status. The key difference here is this second part, "replaced with as many pathnames as possible for each invocation of utility." Instead of one argument per invocation causing many invocations, it is as many arguments as possible with each invocation. Let's try some testing. Let's use sleep to hold the processes alive for a bit so we can verify with ps what is happening. rwp@outrage:/tmp/junk$ time find . -type f -exec sh -c 'sleep 3; echo "$@"' sh {} + ./one ./two ./three ./four ./five ./six ./seven ./eight ./nine ./ten real 0m3.032s user 0m0.000s sys 0m0.010s After starting the above I quickly ran ps in a different terminal so I could see the processes. rwp@outrage:~$ ps PID TT STAT TIME COMMAND 8927 0 Ss 0:00.17 -bash (bash) 9513 0 S+ 0:00.00 find . -type f -exec sh -c sleep 3; echo "$@" sh {} + 9514 0 S+ 0:00.00 sh -c sleep 3; echo "$@" sh ./one ./two ./three ./four ./five ./six ./sev 9515 0 SC+ 0:00.00 sleep 3 9379 1 Ss 0:00.02 -bash (bash) 9516 1 R+ 0:00.00 ps Therefore "find . -exec somecommand {} +" is usually more efficient than piping the character stream of file names to xargs using two processes like this: find . -type f -print0 | xargs -r0 somecomand That has an increased amount of I/O of the long stream of file names that must be written out and then read in by the different processes. That can be more resources than not doing so. But as with many things it all depends upon the exact workload. The place where xargs is definitely an improvement is when using xargs to fork off many parallel processes. If the task is a long running task and needs to crunch a while and the system has multiple cores such that these can be done in parallel then that is a definite improvement. But that adds significant complexity and so far the examples haven't needed it. We can simulate that case by using sleep to idle for a few seconds. And then we will do nothing but echo out the argument list. rwp@outrage:/tmp/junk$ touch one two three four five six seven eight nine ten rwp@outrage:/tmp/junk$ time find . -type f -print0 | xargs -r0 -P 5 -n 1 sh -c 'sleep 3;echo "$@"' sh ./three ./five ./four ./one ./two ./ten ./six ./seven ./nine ./eight real 0m6.157s user 0m0.022s sys 0m0.030s Here there are ten files and I said -P 5 parallel processes. This can then handle everything in two passes when using a 5 process limit. My command simulating doing work slept idle for 3 seconds. I told it only one argument per (parallel) process using -n 1. After starting this in one terminal then in another terminal I looked at the processes running. rwp@outrage:~$ ps PID TT STAT TIME COMMAND 8927 0 Ss 0:00.14 -bash (bash) 9443 0 S+ 0:00.00 xargs -r0 -P 5 -n 1 sh -c sleep 3;echo "$@" sh 9444 0 S+ 0:00.00 sh -c sleep 3;echo "$@" sh ./one 9445 0 S+ 0:00.00 sh -c sleep 3;echo "$@" sh ./two 9446 0 S+ 0:00.00 sh -c sleep 3;echo "$@" sh ./three 9447 0 SC+ 0:00.00 sleep 3 9448 0 SC+ 0:00.00 sleep 3 9449 0 S+ 0:00.00 sh -c sleep 3;echo "$@" sh ./four 9450 0 S+ 0:00.00 sh -c sleep 3;echo "$@" sh ./five 9451 0 SC+ 0:00.00 sleep 3 9452 0 SC+ 0:00.00 sleep 3 9453 0 SC+ 0:00.00 sleep 3 9379 1 Ss 0:00.02 -bash (bash) 9454 1 R+ 0:00.00 ps There are five sleep processes idling simulating the job working. And after 3 seconds those first set of five files were echo'd out. And then after the second pass with another 3 seconds of idle the second set were echo'd out. Because I created the files in a new freshly created directory with touch in order the files were listed out by find in the same order. It's just a quirk of the order in which things were created in that freshly created directory. A busy directory would have likely scrambled things up somewhat. rwp@outrage:/tmp/junk$ rm -rf /tmp/junk rwp@outrage:/tmp/junk$ mkdir /tmp/junk rwp@outrage:/tmp/junk$ cd /tmp/junk rwp@outrage:/tmp/junk$ touch one two three four five six seven eight nine ten rwp@outrage:/tmp/junk$ ls -f ./ ../ one two three four five six seven eight nine ten I am hoping other people are having as much fun with this thread as I am having with it. :-) Bob From owner-freebsd-questions@freebsd.org Mon Oct 19 00:34:42 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8A4AA440156 for ; Mon, 19 Oct 2020 00:34:42 +0000 (UTC) (envelope-from johnl@iecc.com) Received: from gal.iecc.com (gal.iecc.com [IPv6:2001:470:1f07:1126:0:43:6f73:7461]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "gal.iecc.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CDySd0z6Jz3d4g for ; Mon, 19 Oct 2020 00:34:40 +0000 (UTC) (envelope-from johnl@iecc.com) Received: (qmail 15300 invoked from network); 19 Oct 2020 00:34:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=iecc.com; h=date:message-id:from:to:cc:subject:in-reply-to:mime-version:content-type:content-transfer-encoding; s=3bc2.5f8cdf1f.k2010; bh=s53suuU3aEswTqVybjrPoU9MduJXE8zO1H9R9w1vai0=; b=trDc+H57Cnv6rC7Dw2a43JeCc7T1+3EI3ca5dXlAyDQFhG78jk3ljio0TMd6U+6Smt8UChF1o8a8YLt5rBH7korlv9PFzgvuQD07Iy1cPEBWTobWxPFLZN8D9M5FO0pIuYm6Gb2BhA7CbHXduakd1rEbaCVeB0q7TBYstfdxS9JlDIK/ZSco+PRL2MDif2e/j+bGxZ2o+ERxnyAQ/hUKu5mTGUgQyZiUp9576Oh7VLtUHYdGjSHdBFRLASENQqs0JhxXM0uwKOzz6uPqNLrE9FU/MAaQuXWJRSQ91eTQEuuAfDCKpL9MWgkE7ddSa9N6Cee5WDMVCjCKBMNiiDWisw== Received: from ary.qy ([IPv6:2001:470:1f07:1126::78:696d:6170]) by imap.iecc.com ([IPv6:2001:470:1f07:1126::78:696d:6170]) with ESMTPS (TLS1.2 ECDHE-RSA AES-256-GCM AEAD) via TCP6; 19 Oct 2020 00:34:39 -0000 Received: by ary.qy (Postfix, from userid 501) id DEE4923A1E5D; Sun, 18 Oct 2020 20:34:38 -0400 (EDT) Date: 18 Oct 2020 20:34:38 -0400 Message-Id: <20201019003438.DEE4923A1E5D@ary.qy> From: "John Levine" To: freebsd-questions@freebsd.org Cc: bob@proulx.com Subject: Re: sh scripting question In-Reply-To: <20201018155812796938832@bob.proulx.com> Organization: Taughannock Networks X-Headerized: yes Mime-Version: 1.0 Content-type: text/plain; charset=utf-8 Content-transfer-encoding: 8bit X-Rspamd-Queue-Id: 4CDySd0z6Jz3d4g X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=iecc.com header.s=3bc2.5f8cdf1f.k2010 header.b=trDc+H57; dmarc=pass (policy=none) header.from=iecc.com; spf=pass (mx1.freebsd.org: domain of johnl@iecc.com designates 2001:470:1f07:1126:0:43:6f73:7461 as permitted sender) smtp.mailfrom=johnl@iecc.com X-Spamd-Result: default: False [-4.96 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[iecc.com:s=3bc2.5f8cdf1f.k2010]; NEURAL_HAM_MEDIUM(-1.09)[-1.094]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[iecc.com:dkim]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f07:1126::/64]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.965]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[iecc.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[iecc.com,none]; NEURAL_HAM_SHORT(-0.40)[-0.397]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 00:34:42 -0000 In article <20201018155812796938832@bob.proulx.com> you write: >> Sometimes that's better, sometimes not. I have find scripts that delete >> stale files, and it is a lot faster to use xargs to run "rm" once for >> each thousand files than once per file. > -exec utility [argument ...] {} + > Same as -exec, except that “{}” is replaced with as many > pathnames as possible for each invocation of utility. Oh, look at that. Worth a try. R's, John -- Regards, John Levine, johnl@taugh.com, Primary Perpetrator of "The Internet for Dummies", Please consider the environment before reading this e-mail. https://jl.ly From owner-freebsd-questions@freebsd.org Mon Oct 19 05:23:09 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 00CB7445111 for ; Mon, 19 Oct 2020 05:23:09 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CF4sR6HkSz466y for ; Mon, 19 Oct 2020 05:23:07 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from capuchin.riseup.net (capuchin-pn.riseup.net [10.0.1.176]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (not verified)) by mx1.riseup.net (Postfix) with ESMTPS id 4CF4sF3ySvzFf8w for ; Sun, 18 Oct 2020 22:22:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1603084977; bh=IKbrL56SrlY4BMl3wDj9gx2pE5Z0oKXaRKAaooTFbfM=; h=Date:From:To:Subject:In-Reply-To:References:From; b=ShYa/suGjk+aoW9qKXYatzafZMmpHbH5xYADyeMnFFYTAckjXydKtnkIm++wSrUrv 8TkkHn/V9DlUBKOs8AJ1o/RKpA6dkvH0AIqYifTQTe6NzGtX3CyAwkgpdY3Qz+bQQN jiWGR1PV/RhlDoEFzDtwdWFiLCeuwMU+ZMgOyL50= X-Riseup-User-ID: 329D4C3F918F05FB6D0AE3BADC94CF327FD2CCE394F647268D9F470A2212012A Received: from [127.0.0.1] (localhost [127.0.0.1]) by capuchin.riseup.net (Postfix) with ESMTPSA id 4CF4sF0Qrrz8wqX for ; Sun, 18 Oct 2020 22:22:56 -0700 (PDT) Date: Mon, 19 Oct 2020 07:22:43 +0200 From: Ralf Mardorf To: freebsd-questions@freebsd.org Subject: Re: sh scripting question Message-ID: <20201019072243.483c689e@archlinux> In-Reply-To: <20201018144327254822114@bob.proulx.com> References: <20201016113408.16d58d68@archlinux> <24457.35680.223661.203846@jerusalem.litteratus.org> <444kmtudmy.fsf@be-well.ilk.org> <20201018144327254822114@bob.proulx.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CF4sR6HkSz466y X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=riseup.net header.s=squak header.b=ShYa/suG; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (mx1.freebsd.org: domain of ralf-mardorf@riseup.net designates 198.252.153.129 as permitted sender) smtp.mailfrom=ralf-mardorf@riseup.net X-Spamd-Result: default: False [-4.64 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[riseup.net:s=squak]; NEURAL_HAM_MEDIUM(-1.08)[-1.077]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[198.252.153.129:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[riseup.net:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[riseup.net:+]; DMARC_POLICY_ALLOW(-0.50)[riseup.net,none]; NEURAL_HAM_SHORT(-0.95)[-0.954]; NEURAL_HAM_LONG(-1.01)[-1.006]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:16652, ipnet:198.252.153.0/24, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_IN_DNSWL_LOW(-0.10)[198.252.153.129:from] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 05:23:09 -0000 On Sun, 18 Oct 2020 14:37:55 -0600, Bob Proulx wrote: >And yet just the same the shell does handle whitespace and arbitrary >characters in file names easily. > > while IFS= read -r line; do > printf "|%s|\n" "$line" > done < file1 This just reads the file names from a file with a list of file names, now it depends what a user wants to do with those file names. Assuming it is intended to edit those file names depending on filter rules, the script could become very clumsy. The input file names might be "my_fine_stereo_song_named_my_cat_your_dog.wav" "fine_stereo_song_from_your_aunt_called_my_bird_your_bee.wav" and similar. The script should depending on filter rules, process those files and generate new files names "my_odd_stereo_song_left_channel_named_my_cat_your_dog.wav" "my_odd_stereo_song_right_channel_named_my_cat_your_dog.wav" "your_aunts_wonderful_stereo_song_remixed_to_mono_named_my_bird_your_bee.wav" and similar. It's easier to care for a single word separator "_", then to care for arbitrary word separators " ", " *** ", ";", " ", " : " and alternatively CamelCase, too, each on arbitrary positions. Keep in mind, the script already needs to detect the composer mentioned somewhere in the file name etc.. If I would add arbitrary word separators to my already broken English, it would make my sentences much harder to understand. IfIWould ; add.arbitrary <> word seperators. ToMy.already : broken -English,it,would MakeMy. sentences much-HarderTo understand. >And I think everyone is in agreement that the filenames that were >chosen were not the file names that any Unix person would choose to >name their files. No disagreement there. The reason that we are in agreement is, that it is difficult to handle freakish file names. Often enough we note, that our first idea how to name paths and/or directories wasn't optimal, already without using freakish word separators or other odd ideas. On Sun, 18 Oct 2020 15:44:20 -0600, Bob Proulx wrote: >$ find . -type f -exec sh -c 'ls -ld "$@"' sh {} + When writing a script as a file, we do want to write the scripts readable. A script becomes unreadable, if it becomes one long line. Command line is another story. From owner-freebsd-questions@freebsd.org Mon Oct 19 06:13:05 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5BE1244603C for ; Mon, 19 Oct 2020 06:13:05 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CF5z44Ftcz47pc for ; Mon, 19 Oct 2020 06:13:04 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from capuchin.riseup.net (capuchin-pn.riseup.net [10.0.1.176]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (not verified)) by mx1.riseup.net (Postfix) with ESMTPS id 4CF5yz1cX1zFdrF for ; Sun, 18 Oct 2020 23:12:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1603087979; bh=RRssMIkAG94eD371MTOuCQpXkR2kET6QJ/uc8+R9wPM=; h=Date:From:To:Subject:In-Reply-To:References:From; b=BKd8GvRMOnbCchQSxYeSx5XRB0MBfvyxzN1+xF6W6Vsg/XeATg2Dd0BatXe2JJOAp nK9K5MUntYMw5dA0c8NWfFDKuTQL0dKmyzzcZMLPRSqyOm1HGYEsOezY7u9dYa1WtY B2Yl+EuCdy9ETa2c/xZ1iv37c7EG7Mp+H1qAh3uM= X-Riseup-User-ID: 951DC3D45CCBF3A24B4451A6CDC4055AF0078B77B230AF887DF5CE6E32903ACB Received: from [127.0.0.1] (localhost [127.0.0.1]) by capuchin.riseup.net (Postfix) with ESMTPSA id 4CF5yy57F3z8wsB for ; Sun, 18 Oct 2020 23:12:58 -0700 (PDT) Date: Mon, 19 Oct 2020 08:12:50 +0200 From: Ralf Mardorf To: freebsd-questions@freebsd.org Subject: Re: sh scripting question Message-ID: <20201019081250.2c38af5c@archlinux> In-Reply-To: <20201016143802.11156879863c4885fb3dd2e7@sohara.org> References: <24456.60388.135834.43951@jerusalem.litteratus.org> <20201015204226099763897@bob.proulx.com> <20201016063211.2f8b3a74@archlinux> <20201016151942.e01600b6.freebsd@edvax.de> <20201016143802.11156879863c4885fb3dd2e7@sohara.org> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CF5z44Ftcz47pc X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=riseup.net header.s=squak header.b=BKd8GvRM; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (mx1.freebsd.org: domain of ralf-mardorf@riseup.net designates 198.252.153.129 as permitted sender) smtp.mailfrom=ralf-mardorf@riseup.net X-Spamd-Result: default: False [-4.64 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[riseup.net:s=squak]; NEURAL_HAM_MEDIUM(-1.07)[-1.075]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[198.252.153.129:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[riseup.net:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[riseup.net:+]; DMARC_POLICY_ALLOW(-0.50)[riseup.net,none]; NEURAL_HAM_SHORT(-0.96)[-0.957]; NEURAL_HAM_LONG(-1.01)[-1.006]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:16652, ipnet:198.252.153.0/24, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_IN_DNSWL_LOW(-0.10)[198.252.153.129:from] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 06:13:05 -0000 On Fri, 16 Oct 2020 14:38:02 +0100, Steve O'Hara-Smith wrote: >On Fri, 16 Oct 2020 15:19:42 +0200 Polytropon wrote: > >> Fully correct, but also suffers from the lack of a definition >> of "reasonable" that works everywhere every time. :-) > > POSIX portable filenames -they're pretty restrictive though. Speak of the devil and the devil shows up. The first copy is from an ext4 partition to another ext4 partition. The second copy is from the the ext4 partition again, but to a hfs+ partition. [root@archlinux rocketmouse]# date; cp -ai /mnt/winos10/share/.a6400/ /mnt/u5.20sep/; echo $?; date; diff -r /mnt/winos10/share/.a6400/ /mnt/u5.20sep/.a6400/; echo $?; date; cp -ai /mnt/winos10/share/.a6400/ /mnt/u5.hfs/; echo $?; date; diff -r /mnt/winos10/share/.a6400/ /mnt/u5.hfs/.a6400/; echo $?; date Mon 19 Oct 06:00:04 CEST 2020 0 Mon 19 Oct 06:25:30 CEST 2020 0 Mon 19 Oct 06:52:01 CEST 2020 cp: cannot create regular file '/mnt/u5.hfs/.a6400/2020-09-05+06_first_steps/editings/09_00501_edit.jpg': File exists 1 Mon 19 Oct 07:21:52 CEST 2020 Only in /mnt/winos10/share/.a6400/2020-09-05+06_first_steps/editings: 09_00501_edit.jpg 1 Mon 19 Oct 07:51:34 CEST 2020 [root@archlinux rocketmouse]# /usr/bin/ls -hl /mnt/winos10/share/.a6400/2020-09-05+06_first_steps/editings/ /mnt/u5.hfs/.a6400/2020-09-05+06_first_steps/editings/ /mnt/u5.hfs/.a6400/2020-09-05+06_first_steps/editings/: total 53M -rw-r--r-- 1 rocketmouse rocketmouse 3.3M Sep 13 00:58 09_00501_edit.JPG -rw-r--r-- 1 rocketmouse rocketmouse 43M Sep 13 03:42 09_00691_edit.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.7M Sep 13 15:09 09_00802_edit_1.JPG -rw-r--r-- 1 rocketmouse rocketmouse 2.5M Sep 13 15:15 09_00802_edit_2_stretched_contrast.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.1M Sep 13 15:10 09_00803_edit_1.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.6M Sep 13 15:27 09_00803_edit_2_stretched_contrast.JPG /mnt/winos10/share/.a6400/2020-09-05+06_first_steps/editings/: total 61M -rw-r--r-- 1 rocketmouse rocketmouse 3.3M Sep 13 00:58 09_00501_edit.JPG -rw-r--r-- 1 rocketmouse rocketmouse 8.0M Sep 13 00:40 09_00501_edit.jpg -rw-r--r-- 1 rocketmouse rocketmouse 43M Sep 13 03:42 09_00691_edit.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.7M Sep 13 15:09 09_00802_edit_1.JPG -rw-r--r-- 1 rocketmouse rocketmouse 2.5M Sep 13 15:15 09_00802_edit_2_stretched_contrast.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.1M Sep 13 15:10 09_00803_edit_1.JPG -rw-r--r-- 1 rocketmouse rocketmouse 1.6M Sep 13 15:27 09_00803_edit_2_stretched_contrast.JPG From owner-freebsd-questions@freebsd.org Mon Oct 19 06:29:47 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 63A19446440 for ; Mon, 19 Oct 2020 06:29:47 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from mx1.riseup.net (mx1.riseup.net [198.252.153.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CF6LL3Hzbz48vq for ; Mon, 19 Oct 2020 06:29:46 +0000 (UTC) (envelope-from ralf-mardorf@riseup.net) Received: from capuchin.riseup.net (capuchin-pn.riseup.net [10.0.1.176]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "*.riseup.net", Issuer "Sectigo RSA Domain Validation Secure Server CA" (not verified)) by mx1.riseup.net (Postfix) with ESMTPS id 4CF6LB3GTbzFd3Q for ; Sun, 18 Oct 2020 23:29:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1603088978; bh=EiHvtI9GosM43tuSZkzLF+iQzQk5+sYqVxj4LtcqIAU=; h=Subject:From:To:Date:In-Reply-To:References:From; b=KAKopKOMcCfM5slQWlFoz+7MJI0M3Bd/9sVCUf9+0aA7OLZa4CMQtiuApA3iHgJmm R9QvzLvu6YKeMU+u/lT11Pz0P1Cuav9MKcMiVjuvPeC4Xc1448MbiZ6Us7ZhREBAn2 ExyFLmJy8WpKvybUKoRMhsAqLgpJMpH20dhgovR4= X-Riseup-User-ID: 67347DBCBC1B766055C1BB1090BBB9D79583003FC871827DDD35AC0B43774B2B Received: from [127.0.0.1] (localhost [127.0.0.1]) by capuchin.riseup.net (Postfix) with ESMTPSA id 4CF6L95fMWz8wwC for ; Sun, 18 Oct 2020 23:29:33 -0700 (PDT) Message-ID: <003d02dad3abc652a985d4466ebfc2566a0c0df2.camel@riseup.net> Subject: Re: sh scripting question From: Ralf Mardorf To: freebsd-questions@freebsd.org Date: Mon, 19 Oct 2020 08:29:15 +0200 In-Reply-To: <20201019072243.483c689e@archlinux> References: <20201016113408.16d58d68@archlinux> <24457.35680.223661.203846@jerusalem.litteratus.org> <444kmtudmy.fsf@be-well.ilk.org> <20201018144327254822114@bob.proulx.com> <20201019072243.483c689e@archlinux> Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CF6LL3Hzbz48vq X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=riseup.net header.s=squak header.b=KAKopKOM; dmarc=pass (policy=none) header.from=riseup.net; spf=pass (mx1.freebsd.org: domain of ralf-mardorf@riseup.net designates 198.252.153.129 as permitted sender) smtp.mailfrom=ralf-mardorf@riseup.net X-Spamd-Result: default: False [-5.16 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[riseup.net:s=squak]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[198.252.153.129:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[riseup.net:dkim]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.05)[-1.049]; DKIM_TRACE(0.00)[riseup.net:+]; DMARC_POLICY_ALLOW(-0.50)[riseup.net,none]; NEURAL_HAM_SHORT(-1.01)[-1.007]; NEURAL_HAM_LONG(-1.00)[-1.002]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16652, ipnet:198.252.153.0/24, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_IN_DNSWL_LOW(-0.10)[198.252.153.129:from] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 06:29:47 -0000 On Mon, 2020-10-19 at 07:22 +0200, Ralf Mardorf wrote: > The reason that we are in agreement is, that it is difficult to handle > freakish file names. Often enough we note, that our first idea how to > name paths and/or directories wasn't optimal, already without using ^^^^^^^^^^^ or files ;) > freakish word separators or other odd ideas. From owner-freebsd-questions@freebsd.org Mon Oct 19 14:06:32 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CAC6C428DA0 for ; Mon, 19 Oct 2020 14:06:32 +0000 (UTC) (envelope-from sl8ixw@rp.postal.labs.k.io) Received: from mx95.labs.k.io (mx95.labs.k.io [IPv6:2a03:2800:300::95]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFJTM3pGdz4dG6 for ; Mon, 19 Oct 2020 14:06:31 +0000 (UTC) (envelope-from sl8ixw@rp.postal.labs.k.io) Resent-Sender: sl8ixw@rp.postal.labs.k.io DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=email.sirportly.com; s=postal-QEE0Jp; t=1603116382; bh=54Tx3pTwmHvBH0TJJ4dek4r9GQzzvUYoO95RuLbS+KM=; h=date:from:to:cc:message-id:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding; b=xdFmdRc4FVTO/vWQOtN5dynpUP5u4dd3qgdB2mcN4bnbXQmcNFXutwN8JzujeojZLQXwCRc+ls055+7dCDBvQlQw5p1T/csFSS6kTc/09GtQ6ilZpT7Vr4ndCepNF2n86Ko9iNkYObHJfMnBe95y/PtbZwmV5Q+sV+n5hOg6OnU= X-Postal-MsgID: jELxC8SGgNmJ Received: from app.sirportly.com (::ffff:185.22.211.50 [::ffff:185.22.211.50]) by postal.labs.k.io with SMTP; Mon, 19 Oct 2020 14:06:22 -0000 Date: Mon, 19 Oct 2020 15:06:22 +0100 From: Twingly Customer Support To: team@twingly.com Cc: freebsd-questions@freebsd.org, freebsd@jschneider.net Message-ID: <5f8d9d5e14b4c_dad82b12ba6585a44346f@sirportly-app-01.mail> In-Reply-To: <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> References: <20201016195748.ffc15759b311a5feefc91ef5@sohara.org> <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> Subject: Re: FreeBSD using swap even though there's a lot of free memory Mime-Version: 1.0 X-Mailer: Sirportly/5.16.2 X-Rspamd-Queue-Id: 4CFJTM3pGdz4dG6 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email.sirportly.com header.s=postal-QEE0Jp header.b=xdFmdRc4; dmarc=none; spf=pass (mx1.freebsd.org: domain of sl8ixw@rp.postal.labs.k.io designates 2a03:2800:300::95 as permitted sender) smtp.mailfrom=sl8ixw@rp.postal.labs.k.io X-Spamd-Result: default: False [-1.73 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.07)[-1.073]; R_DKIM_ALLOW(-0.20)[email.sirportly.com:s=postal-QEE0Jp]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2a03:2800:300::/64]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[twingly.com]; NEURAL_HAM_LONG(-0.95)[-0.946]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[email.sirportly.com:+]; NEURAL_HAM_SHORT(-0.01)[-0.009]; FORGED_SENDER(0.30)[team@twingly.com,sl8ixw@rp.postal.labs.k.io]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:12488, ipnet:2a03:2800::/29, country:GB]; FROM_NEQ_ENVFROM(0.00)[team@twingly.com,sl8ixw@rp.postal.labs.k.io]; MAILMAN_DEST(0.00)[freebsd-questions] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 14:06:32 -0000 > Are you using a swap backed tmpfs ? No, we don't use tmpfs. This is how we define our swap partition: % cat /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/mirror/swap.eli none swap sw 0 0 Fortunately the problem does no longer occur since this Friday, Oct 16, which is when we ran "pkg upgrade -y" the last time. There has been no swap usage (or laundry either for that matter) since then, also the memory (active + inactive + wired) has now been over 200G for the first time since the problems started. I have started ZFS scrub, and even after that the swap is empty. We update packages regularly, and we have done that multiple times since our problems started, but this time the problem went away. We have not made any other changes to the system recently (other than updating packages) that could have caused these problems. I have not taken a closer look at what exactly has changed in the packages that got updated yet, but these are all the packages that was changed (output from "pkg upgrade -y"): Installed packages to be UPGRADED: gnutls: 3.6.13 -> 3.6.14 libnghttp2: 1.40.0 -> 1.41.0 perl5: 5.30.2 -> 5.30.3 python37: 3.7.7 -> 3.7.7_1 I'll continue and see if I manage to figure out which (if any) of the above packages could have caused this. Also, thanks to Doug for the following: > I encountered this issue a year or so ago. In my case it turned out to = > be a process that was allocating anonymous segments using mmap. It = > tended to forget to free them after the usage was complete. As a = > result, the system would run out of swap even though there was plenty of = > free memory. Anonymous segments are mapped to swap space. I traced the = > problem using: > > procstat -va | grep df > > That generated a lot of data. I looked for processes that had an = > increasing number of df files. Eventually I found the right one and = > fixed it. I'll be sure to remember this in case I run into things like these in the future. // Mattias -------------------------------------------------------------------------------- On October 16, 2020 20:57 Steve O'Hara-Smith wrote: On Thu, 15 Oct 2020 15:23:51 +0100 Twingly Customer Support wrote: > Eventually, after scrubbing a few times, the swap becomes full and we > start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. Are you using a swap backed tmpfs ? -- Steve O'Hara-Smith -------------------------------------------------------------------------------- On October 16, 2020 19:50 doug wrote: On Thu, 15 Oct 2020, Jon Schneider wrote: >top -w -oswap > >seems to report the right thing. Would be interesting if it's _not_ MySQL. > >Jon > >On 15/10/2020 15:23, Twingly Customer Support wrote: >>Hi, >> >>We have a server running FreeBSD 12.1-RELEASE-p10. We currently have a problem where FreeBSD starting to swap when running ZFS scrub, even though we have ~70G of free memory. >>This did not happen before when running FreeBSD 11.3 for example. It started happening at approximately the time we upgraded from 12.1-RELEASE-p5 to 12.1-RELEASE-p6, but if the upgrade is the cause of the problem is unclear, though FreeBSD never swapped for us before that. "Laundry" memory was not something we saw before either, it started to appear at the same time as FreeBSD started swapping. >> >>Eventually, after scrubbing a few times, the swap becomes full and we start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. >>This is the memory usage a while after scrubbing, note the values for Mem/Free and Swap: >> >>``` >>% top | head -n 7 >>last pid: 8112; load averages: 1.82, 1.77, 1.73 up 6+01:37:42 10:53:48 >>35 processes: 1 running, 34 sleeping >>CPU: 4.9% user, 0.0% nice, 4.2% system, 0.2% interrupt, 90.7% idle >>Mem: 110G Active, 27G Inact, 5413M Laundry, 39G Wired, 68G Free >>ARC: 34G Total, 28G MFU, 4101M MRU, 53M Anon, 1317M Header, 225M Other >> 30G Compressed, 53G Uncompressed, 1.77:1 Ratio >>Swap: 8192M Total, 6434M Used, 1757M Free, 78% Inuse >>``` >> >>We are running MySQL, which has been configured to use ~50% of the total amount memory (using innodb_buffer_pool_size=127748M) >>ZFS ARC has been configured to use 25% of the total memory (using vfs.zfs.arc_max="63874M") >> >>We have tried raising both vfs.zfs.arc_max and innodb_buffer_pool_size, but this did not make any change to the total memory usage, the free memory stays at around 70G and FreeBSD still started swapping. >>It's as if the memory is capped at around 180G for some reason. >> >>Are there any configuration values that could cause FreeBSD to swap even though there's free memory? Are there any config values one could try to change in order to get FreeBSD to use the remaining ~70G of free memory instead of swapping? >> >>Let me know if there's any more details you want me to provide and I'll attach those. >> >>Thanks! >> >>// Mattias I see similar things. The Jails in question are 11.1. The systems updated to 12.1 do not display this behavior. This 11.1 system runs 5 jails. Swapinfo is shown below: Device 1K-blocks Used Avail Capacity /dev/aacd0p3 4194304 1776000 2418304 42% These numbers are developed from top on the base system [ 0 50861 ] root [ 20 281903 ] camden squirellmail/roundcube/postfix/mysql [ 21 322759 ] bassharbor wordpress/php56 [ 19 343522 ] monhegan wordpress/php56 [ 18 369139 ] newharbor apache24/sendmail [ 17 587332 ] pemaquid wordpress/php74 Jails: 1904655 total: 1955516 I read somewhere that the virtual memory system pre-pages modified pages as a just-in-case measure. If this is correct, 12.1 does not do this on a non-paging system. The system shown above uses about 10% swapspace after a reboot and works its way to the 42% shown above in a day or so. -------------------------------------------------------------------------------- On October 15, 2020 18:21 Jon Schneider wrote: top -w -oswap seems to report the right thing. Would be interesting if it's _not_ MySQL. Jon -------------------------------------------------------------------------------- On October 15, 2020 16:24 Team Twingly wrote: Hi, We have a server running FreeBSD 12.1-RELEASE-p10. We currently have a problem where FreeBSD starting to swap when running ZFS scrub, even though we have ~70G of free memory. This did not happen before when running FreeBSD 11.3 for example. It started happening at approximately the time we upgraded from 12.1-RELEASE-p5 to 12.1-RELEASE-p6, but if the upgrade is the cause of the problem is unclear, though FreeBSD never swapped for us before that. "Laundry" memory was not something we saw before either, it started to appear at the same time as FreeBSD started swapping. Eventually, after scrubbing a few times, the swap becomes full and we start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. This is the memory usage a while after scrubbing, note the values for Mem/Free and Swap: ``` % top | head -n 7 last pid: 8112; load averages: 1.82, 1.77, 1.73 up 6+01:37:42 10:53:48 35 processes: 1 running, 34 sleeping CPU: 4.9% user, 0.0% nice, 4.2% system, 0.2% interrupt, 90.7% idle Mem: 110G Active, 27G Inact, 5413M Laundry, 39G Wired, 68G Free ARC: 34G Total, 28G MFU, 4101M MRU, 53M Anon, 1317M Header, 225M Other 30G Compressed, 53G Uncompressed, 1.77:1 Ratio Swap: 8192M Total, 6434M Used, 1757M Free, 78% Inuse ``` We are running MySQL, which has been configured to use ~50% of the total amount memory (using innodb_buffer_pool_size=127748M) ZFS ARC has been configured to use 25% of the total memory (using vfs.zfs.arc_max="63874M") We have tried raising both vfs.zfs.arc_max and innodb_buffer_pool_size, but this did not make any change to the total memory usage, the free memory stays at around 70G and FreeBSD still started swapping. It's as if the memory is capped at around 180G for some reason. Are there any configuration values that could cause FreeBSD to swap even though there's free memory? Are there any config values one could try to change in order to get FreeBSD to use the remaining ~70G of free memory instead of swapping? Let me know if there's any more details you want me to provide and I'll attach those. Thanks! // Mattias From owner-freebsd-questions@freebsd.org Mon Oct 19 15:14:57 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 16EAA42B7AF for ; Mon, 19 Oct 2020 15:14:57 +0000 (UTC) (envelope-from sl8ixw@rp.postal.labs.k.io) Received: from mx95.labs.k.io (mx95.labs.k.io [IPv6:2a03:2800:300::95]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFL0J1120z3V18 for ; Mon, 19 Oct 2020 15:14:55 +0000 (UTC) (envelope-from sl8ixw@rp.postal.labs.k.io) Resent-Sender: sl8ixw@rp.postal.labs.k.io DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=email.sirportly.com; s=postal-QEE0Jp; t=1603120492; bh=S9Et1GKk6Ppui3roXnmtlZJ16/vAp0/+01wpIA5BqBg=; h=date:from:to:cc:message-id:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding; b=XnYlHHVvG39ymlL7OLY+9iJjmpg/2JPKzTgLdm+rHUSvzgyD0laOmiHSFn7rJqqrXVHW98SaGeWxsvZvHEt5JugOwkOB8dQgHzOrzjVBwnquLOmkGbVeKlWJf363h8gQhKVfqbeH8LvpOkrf+P6MYI2KMmia/69BrqV8+wJSxSM= X-Postal-MsgID: ZVqIHLKwwuGv Received: from app.sirportly.com (::ffff:185.22.211.50 [::ffff:185.22.211.50]) by postal.labs.k.io with SMTP; Mon, 19 Oct 2020 15:14:52 -0000 Date: Mon, 19 Oct 2020 16:14:52 +0100 From: Twingly Customer Support To: team@twingly.com Cc: freebsd-questions@freebsd.org, freebsd@jschneider.net Message-ID: <5f8dad6c5225e_11f782aaeb993e5bc705b@sirportly-app-01.mail> In-Reply-To: <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> References: <5f8d9d5e14b4c_dad82b12ba6585a44346f@sirportly-app-01.mail> <20201016195748.ffc15759b311a5feefc91ef5@sohara.org> <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> Subject: Re: FreeBSD using swap even though there's a lot of free memory Mime-Version: 1.0 X-Mailer: Sirportly/5.16.2 X-Rspamd-Queue-Id: 4CFL0J1120z3V18 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email.sirportly.com header.s=postal-QEE0Jp header.b=XnYlHHVv; dmarc=none; spf=pass (mx1.freebsd.org: domain of sl8ixw@rp.postal.labs.k.io designates 2a03:2800:300::95 as permitted sender) smtp.mailfrom=sl8ixw@rp.postal.labs.k.io X-Spamd-Result: default: False [-2.47 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.028]; R_DKIM_ALLOW(-0.20)[email.sirportly.com:s=postal-QEE0Jp]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2a03:2800:300::/64]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[twingly.com]; NEURAL_HAM_LONG(-0.95)[-0.946]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[email.sirportly.com:+]; NEURAL_HAM_SHORT(-0.79)[-0.791]; FORGED_SENDER(0.30)[team@twingly.com,sl8ixw@rp.postal.labs.k.io]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:12488, ipnet:2a03:2800::/29, country:GB]; FROM_NEQ_ENVFROM(0.00)[team@twingly.com,sl8ixw@rp.postal.labs.k.io]; MAILMAN_DEST(0.00)[freebsd-questions] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 15:14:57 -0000 A correction: The output from "pkg upgrade -y" in my previous email was the version of the packages that was installed right as the problem started. The following are the updates that was installed last Friday, which seems to have solved the problem: New packages to be INSTALLED: bash-completion: 2.11,2 glib: 2.66.0_1,1 postgresql12-client: 12.4 Installed packages to be UPGRADED: bash: 5.0.17 -> 5.0.18_3 ca_root_nss: 3.56 -> 3.57 fio: 3.20 -> 3.23 gettext-runtime: 0.20.2 -> 0.21 git: 2.27.0 -> 2.28.0 iozone: 3.487 -> 3.487_1 libffi: 3.2.1_3 -> 3.3_1 libgpg-error: 1.38 -> 1.39 memcached: 1.6.5 -> 1.6.7 mosh: 1.3.2_13 -> 1.3.2_14 munin-common: 2.0.63 -> 2.0.64 munin-node: 2.0.63 -> 2.0.64 net-snmp: 5.7.3_20,1 -> 5.9,1 p11-kit: 0.23.20 -> 0.23.21 p5-DBD-Pg: 3.13.0 -> 3.14.2 p5-DateTime-HiRes: 0.01_1 -> 0.04 p5-DateTime-Locale: 1.25 -> 1.28 p5-HTTP-Message: 6.24 -> 6.26 p5-Log-Log4perl: 1.49 -> 1.53 p5-Mozilla-CA: 20180117 -> 20200520 p5-Net-DNS: 1.25,1 -> 1.27,1 p5-XML-LibXML: 2.0204,1 -> 2.0206,1 p5-libwww: 6.46 -> 6.49 perl5: 5.30.3 -> 5.32.0 postgresql11-client: 11.8 -> 11.9 protobuf: 3.12.3,1 -> 3.13.0,1 py37-pip: 19.1.1 -> 20.2.3 ruby: 2.6.6,1 -> 2.6.6_1,1 sqlite3: 3.32.2,1 -> 3.33.0,1 sudo: 1.9.2 -> 1.9.3p1 vim-console: 8.2.1110 -> 8.2.1558 xxhash: 0.7.4 -> 0.8.0 zstd: 1.4.5 -> 1.4.5_1 Sorry about the confusion! :) // Mattias -------------------------------------------------------------------------------- On October 19, 2020 16:06 Twingly Customer Support wrote: > Are you using a swap backed tmpfs ? No, we don't use tmpfs. This is how we define our swap partition: % cat /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/mirror/swap.eli none swap sw 0 0 Fortunately the problem does no longer occur since this Friday, Oct 16, which is when we ran "pkg upgrade -y" the last time. There has been no swap usage (or laundry either for that matter) since then, also the memory (active + inactive + wired) has now been over 200G for the first time since the problems started. I have started ZFS scrub, and even after that the swap is empty. We update packages regularly, and we have done that multiple times since our problems started, but this time the problem went away. We have not made any other changes to the system recently (other than updating packages) that could have caused these problems. I have not taken a closer look at what exactly has changed in the packages that got updated yet, but these are all the packages that was changed (output from "pkg upgrade -y"): Installed packages to be UPGRADED: gnutls: 3.6.13 -> 3.6.14 libnghttp2: 1.40.0 -> 1.41.0 perl5: 5.30.2 -> 5.30.3 python37: 3.7.7 -> 3.7.7_1 I'll continue and see if I manage to figure out which (if any) of the above packages could have caused this. Also, thanks to Doug for the following: I'll be sure to remember this in case I run into things like these in the future. // Mattias -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- On October 19, 2020 16:05 Mattias Roback wrote: > Are you using a swap backed tmpfs ? No, we don't use tmpfs. This is how we define our swap partition: % cat /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/mirror/swap.eli none swap sw 0 0 Fortunately the problem does no longer occur since this Friday, Oct 16, which is when we ran "pkg upgrade -y" the last time. There has been no swap usage (or laundry either for that matter) since then, also the memory (active + inactive + wired) has now been over 200G for the first time since the problems started. I have started ZFS scrub, and even after that the swap is empty. We update packages regularly, and we have done that multiple times since our problems started, but this time the problem went away. We have not made any other changes to the system recently (other than updating packages) that could have caused these problems. I have not taken a closer look at what exactly has changed in the packages that got updated yet, but these are all the packages that was changed (output from "pkg upgrade -y"): Installed packages to be UPGRADED: gnutls: 3.6.13 -> 3.6.14 libnghttp2: 1.40.0 -> 1.41.0 perl5: 5.30.2 -> 5.30.3 python37: 3.7.7 -> 3.7.7_1 I'll continue and see if I manage to figure out which (if any) of the above packages could have caused this. Also, thanks to Doug for the following: > I encountered this issue a year or so ago. In my case it turned out to = > be a process that was allocating anonymous segments using mmap. It = > tended to forget to free them after the usage was complete. As a = > result, the system would run out of swap even though there was plenty of = > free memory. Anonymous segments are mapped to swap space. I traced the = > problem using: > > procstat -va | grep df > > That generated a lot of data. I looked for processes that had an = > increasing number of df files. Eventually I found the right one and = > fixed it. I'll be sure to remember this in case I run into things like these in the future. // Mattias -------------------------------------------------------------------------------- On October 16, 2020 20:57 Steve O'Hara-Smith wrote: On Thu, 15 Oct 2020 15:23:51 +0100 Twingly Customer Support wrote: > Eventually, after scrubbing a few times, the swap becomes full and we > start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. Are you using a swap backed tmpfs ? -- Steve O'Hara-Smith -------------------------------------------------------------------------------- On October 16, 2020 19:50 doug wrote: On Thu, 15 Oct 2020, Jon Schneider wrote: >top -w -oswap > >seems to report the right thing. Would be interesting if it's _not_ MySQL. > >Jon > >On 15/10/2020 15:23, Twingly Customer Support wrote: >>Hi, >> >>We have a server running FreeBSD 12.1-RELEASE-p10. We currently have a problem where FreeBSD starting to swap when running ZFS scrub, even though we have ~70G of free memory. >>This did not happen before when running FreeBSD 11.3 for example. It started happening at approximately the time we upgraded from 12.1-RELEASE-p5 to 12.1-RELEASE-p6, but if the upgrade is the cause of the problem is unclear, though FreeBSD never swapped for us before that. "Laundry" memory was not something we saw before either, it started to appear at the same time as FreeBSD started swapping. >> >>Eventually, after scrubbing a few times, the swap becomes full and we start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. >>This is the memory usage a while after scrubbing, note the values for Mem/Free and Swap: >> >>``` >>% top | head -n 7 >>last pid: 8112; load averages: 1.82, 1.77, 1.73 up 6+01:37:42 10:53:48 >>35 processes: 1 running, 34 sleeping >>CPU: 4.9% user, 0.0% nice, 4.2% system, 0.2% interrupt, 90.7% idle >>Mem: 110G Active, 27G Inact, 5413M Laundry, 39G Wired, 68G Free >>ARC: 34G Total, 28G MFU, 4101M MRU, 53M Anon, 1317M Header, 225M Other >> 30G Compressed, 53G Uncompressed, 1.77:1 Ratio >>Swap: 8192M Total, 6434M Used, 1757M Free, 78% Inuse >>``` >> >>We are running MySQL, which has been configured to use ~50% of the total amount memory (using innodb_buffer_pool_size=127748M) >>ZFS ARC has been configured to use 25% of the total memory (using vfs.zfs.arc_max="63874M") >> >>We have tried raising both vfs.zfs.arc_max and innodb_buffer_pool_size, but this did not make any change to the total memory usage, the free memory stays at around 70G and FreeBSD still started swapping. >>It's as if the memory is capped at around 180G for some reason. >> >>Are there any configuration values that could cause FreeBSD to swap even though there's free memory? Are there any config values one could try to change in order to get FreeBSD to use the remaining ~70G of free memory instead of swapping? >> >>Let me know if there's any more details you want me to provide and I'll attach those. >> >>Thanks! >> >>// Mattias I see similar things. The Jails in question are 11.1. The systems updated to 12.1 do not display this behavior. This 11.1 system runs 5 jails. Swapinfo is shown below: Device 1K-blocks Used Avail Capacity /dev/aacd0p3 4194304 1776000 2418304 42% These numbers are developed from top on the base system [ 0 50861 ] root [ 20 281903 ] camden squirellmail/roundcube/postfix/mysql [ 21 322759 ] bassharbor wordpress/php56 [ 19 343522 ] monhegan wordpress/php56 [ 18 369139 ] newharbor apache24/sendmail [ 17 587332 ] pemaquid wordpress/php74 Jails: 1904655 total: 1955516 I read somewhere that the virtual memory system pre-pages modified pages as a just-in-case measure. If this is correct, 12.1 does not do this on a non-paging system. The system shown above uses about 10% swapspace after a reboot and works its way to the 42% shown above in a day or so. -------------------------------------------------------------------------------- On October 15, 2020 18:21 Jon Schneider wrote: top -w -oswap seems to report the right thing. Would be interesting if it's _not_ MySQL. Jon -------------------------------------------------------------------------------- On October 15, 2020 16:24 Team Twingly wrote: Hi, We have a server running FreeBSD 12.1-RELEASE-p10. We currently have a problem where FreeBSD starting to swap when running ZFS scrub, even though we have ~70G of free memory. This did not happen before when running FreeBSD 11.3 for example. It started happening at approximately the time we upgraded from 12.1-RELEASE-p5 to 12.1-RELEASE-p6, but if the upgrade is the cause of the problem is unclear, though FreeBSD never swapped for us before that. "Laundry" memory was not something we saw before either, it started to appear at the same time as FreeBSD started swapping. Eventually, after scrubbing a few times, the swap becomes full and we start seeing "swap_pager_getswapspace(24): failed" etc. in dmesg. This is the memory usage a while after scrubbing, note the values for Mem/Free and Swap: ``` % top | head -n 7 last pid: 8112; load averages: 1.82, 1.77, 1.73 up 6+01:37:42 10:53:48 35 processes: 1 running, 34 sleeping CPU: 4.9% user, 0.0% nice, 4.2% system, 0.2% interrupt, 90.7% idle Mem: 110G Active, 27G Inact, 5413M Laundry, 39G Wired, 68G Free ARC: 34G Total, 28G MFU, 4101M MRU, 53M Anon, 1317M Header, 225M Other 30G Compressed, 53G Uncompressed, 1.77:1 Ratio Swap: 8192M Total, 6434M Used, 1757M Free, 78% Inuse ``` We are running MySQL, which has been configured to use ~50% of the total amount memory (using innodb_buffer_pool_size=127748M) ZFS ARC has been configured to use 25% of the total memory (using vfs.zfs.arc_max="63874M") We have tried raising both vfs.zfs.arc_max and innodb_buffer_pool_size, but this did not make any change to the total memory usage, the free memory stays at around 70G and FreeBSD still started swapping. It's as if the memory is capped at around 180G for some reason. Are there any configuration values that could cause FreeBSD to swap even though there's free memory? Are there any config values one could try to change in order to get FreeBSD to use the remaining ~70G of free memory instead of swapping? Let me know if there's any more details you want me to provide and I'll attach those. Thanks! // Mattias From owner-freebsd-questions@freebsd.org Mon Oct 19 15:33:09 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4964942BFB3 for ; Mon, 19 Oct 2020 15:33:09 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFLPJ0zHvz3WDS for ; Mon, 19 Oct 2020 15:33:07 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r56.edvax.de ([94.222.3.6]) by mrelayeu.kundenserver.de (mreue012 [212.227.15.167]) with ESMTPA (Nemesis) id 1MLAZe-1kmknM2A8w-00IGlA; Mon, 19 Oct 2020 17:33:02 +0200 Date: Mon, 19 Oct 2020 17:33:01 +0200 From: Polytropon To: "John R. Levine" Cc: "Steve O'Hara-Smith" , freebsd-questions@freebsd.org, naddy@mips.inka.de Subject: Re: printf(1) and UTF-8 multi-byte chars Message-Id: <20201019173301.0a8fe5b4.freebsd@edvax.de> In-Reply-To: <3c62a326-887f-4f4e-dbb2-56666f7571a0@iecc.com> References: <20201018154838.49CBC239CEDF@ary.qy> <20201018182309.490ff752536eae2092533c5a@sohara.org> <3c62a326-887f-4f4e-dbb2-56666f7571a0@iecc.com> Reply-To: Polytropon Organization: EDVAX X-Mailer: Sylpheed 3.1.1 (GTK+ 2.24.5; i386-portbld-freebsd8.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:vYFrt/8kxHGC2uvXvn8Q3q6TqJLVm1MxGSagCtR6ZlWRwl5POdg BRq4uPQzyV3AP21afxE5e/iEhw0iFE0p5FL2LEQeJY+dxpj6DlADvTK9SEtlpQDkUwc41ok 2b0qDLeUIF+3u2Bbso+uJy+g4ybmCIN0tSGCFnbiFdpAYohwJur7NMFrFQ1HR+29nEc9faO Af72u0zlNUPANotIoEQfw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:t+DicC1sugs=:L++zT83+VkAaDQXKxu5miP pPTWo6rJOtjM6C2K1cnY5RylHiNXsJ5Kqe8L3fudGHw9zhuvUpTrJGSrw01pSRVwRIp/D6nUb 12ZIX1xT411ggwIRshEqxu9qAWo6RDeZGh3N7WgeNzmkdIUMwsIkV/tPE9ogx1liGG/z1p+UI z1IiE6IsmM6Y785TEz7Mg9V37L1auUHtlVdejcKPF5zIzU3tfwsMmv/gNpQsuXQzrQZudVVu+ HTVArY5DtOrvIB/T/ZE1zeegS+rYz4OoCGd5cqwutZpIFLTK5RQe812PzmCOVLJfNfyKckVh2 tIVzF1lWjiAUWk207WxqxfSa/4DmqYmSIEJsIufSet9VDfQzlWQbFdTRxN6Qc8Bb4ZeZ5Y+r9 P6v9N+4WW4aIRBfVNvOvBB2bsSVSgHcFAjmnShFNudwzMPztX/hTzAJmdGJKW X-Rspamd-Queue-Id: 4CFLPJ0zHvz3WDS X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@edvax.de has no SPF policy when checking 212.227.126.130) smtp.mailfrom=freebsd@edvax.de X-Spamd-Result: default: False [0.94 / 15.00]; HAS_REPLYTO(0.00)[freebsd@edvax.de]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; HAS_ORG_HEADER(0.00)[]; NEURAL_HAM_SHORT(-0.69)[-0.693]; RECEIVED_SPAMHAUS_PBL(0.00)[94.222.3.6:received]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.64)[-0.636]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-0.14)[-0.136]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[edvax.de]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_CONTAINS_FROM(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[212.227.126.130:from]; R_SPF_NA(0.00)[no SPF record]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.126.130:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 15:33:09 -0000 On 18 Oct 2020 14:05:46 -0400, John R. Levine wrote: > > There are good reasons for using all three levels, here are some: > > > > Bytes: Content length headers, malloc calls - storage related > > Sure. > > > Glyphs: Truncation, apparent length, sorting - appearance related > > Not so much. I suppose it's preferable to truncate at a glyph boundary, > [...] Depends. Some gylphs depicting ligatures decay to different single characters upon truncation / hyphenation. > [...] > but sorting UTF-8 bytes gives you the same order as sorting the glyphs, > and for useful sorting you need to deal with issues like normalized forms > and case folding. Not sure what use apparent length would be since the > number of glyphs tells you neither the number of visible characters nor > how wide they are. Exactly that is the main problem with "byte length != string length" as a general problem with non-ASCII text. Processing and even displaying can be quite tricky, and printf() is not trivial anymore... ;-) -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-questions@freebsd.org Mon Oct 19 16:38:50 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0013E42E081 for ; Mon, 19 Oct 2020 16:38:49 +0000 (UTC) (envelope-from doug@safeport.com) Received: from cyrus.watson.org (cyrus.watson.org [204.107.128.30]) by mx1.freebsd.org (Postfix) with ESMTP id 4CFMs531rRz3ZmG for ; Mon, 19 Oct 2020 16:38:49 +0000 (UTC) (envelope-from doug@safeport.com) Received: from fledge.watson.org (fledge.watson.org [198.74.231.63]) by cyrus.watson.org (Postfix) with ESMTPS id 9EC7D2317; Mon, 19 Oct 2020 16:33:32 +0000 (UTC) Received: from fledge.watson.org (doug@localhost [127.0.0.1]) by fledge.watson.org (8.16.1/8.16.1) with ESMTPS id 09JGXWA6077753 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 19 Oct 2020 16:33:32 GMT (envelope-from doug@safeport.com) Received: from localhost (doug@localhost) by fledge.watson.org (8.16.1/8.16.1/Submit) with ESMTP id 09JGXWgA077749; Mon, 19 Oct 2020 16:33:32 GMT (envelope-from doug@safeport.com) X-Authentication-Warning: fledge.watson.org: doug owned process doing -bs Date: Mon, 19 Oct 2020 16:33:32 +0000 (UTC) From: doug@safeport.com X-X-Sender: doug@fledge.watson.org Reply-To: doug@fledge.watson.org To: "Steve O'Hara-Smith" cc: Doug Hardie , FreeBSD Mailing List Subject: Re: FreeBSD using swap even though there's a lot of free memory In-Reply-To: <20201016212841.0864fb91b9f2e72e1246bbfa@sohara.org> Message-ID: References: <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> <20201016195546.a3392f971837aa2eeace1325@sohara.org> <89B99A9E-C3A2-47BE-8A0E-D296846946CB@mail.sermon-archive.info> <20201016212841.0864fb91b9f2e72e1246bbfa@sohara.org> User-Agent: Alpine 2.21.9999 (BSF 287 2018-06-16) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4CFMs531rRz3ZmG X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=fail (mx1.freebsd.org: domain of doug@safeport.com does not designate 204.107.128.30 as permitted sender) smtp.mailfrom=doug@safeport.com X-Spamd-Result: default: False [5.53 / 15.00]; ARC_NA(0.00)[]; R_SPF_FAIL(1.00)[-all:c]; HAS_REPLYTO(0.00)[doug@fledge.watson.org]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.76)[0.758]; REPLYTO_DN_EQ_FROM_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; HAS_XAW(0.00)[]; NEURAL_SPAM_MEDIUM(0.47)[0.473]; DMARC_NA(0.00)[safeport.com]; NEURAL_HAM_LONG(-0.20)[-0.199]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; VIOLATED_DIRECT_SPF(3.50)[]; FROM_NO_DN(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11288, ipnet:204.107.128.0/24, country:US]; GREYLIST(0.00)[pass,body]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 16:38:50 -0000 On Fri, 16 Oct 2020, Steve O'Hara-Smith wrote: > On Fri, 16 Oct 2020 13:24:13 -0700 > Doug Hardie wrote: > >> I encountered this issue a year or so ago. In my case it turned out to >> be a process that was allocating anonymous segments using mmap. > > Now that's an interesting one - thank you for mentioning it. Neither is the case for me. A 'real' swapfile and no paging. I have a range of FreeBSD versions with the kind of workload using up swap space. For me only the 11.1 system does this. The current numbers below show some "lost" space but the unaccounted for space is a relative small amount. Device 1K-blocks Used Avail Capacity /dev/aacd0p3 4194304 1776000 2418304 42% [ 0 50861 ] root [ 20 281903 ] camden [ 21 322759 ] bassharbor [ 19 343522 ] monhegan [ 18 369139 ] newharbor [ 17 587332 ] pemaquid Jails: 1904655 total: 1955516 I wrote a program to track this in real time as several weeks ago the system ran out of swap space. Numbers are from top. From owner-freebsd-questions@freebsd.org Mon Oct 19 22:20:12 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8DE204362F4 for ; Mon, 19 Oct 2020 22:20:12 +0000 (UTC) (envelope-from dvoich@aim.com) Received: from sonic317-27.consmr.mail.bf2.yahoo.com (sonic317-27.consmr.mail.bf2.yahoo.com [74.6.129.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFWQw3jwzz4GvQ for ; Mon, 19 Oct 2020 22:20:08 +0000 (UTC) (envelope-from dvoich@aim.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aim.com; s=a2048; t=1603146007; bh=qjyJtA7m78Jn0Jmn8jpryxjxl7DoYY4wbGA6z1huO4R=; h=Date:From:To:Subject; b=slv7tXW9iFOD5HjF6aysam8DpQbkWIC5r6o2MSZDbC4sVFyq9YSM00iuhBO1RKI8iFf83iikRG7/NpjUBL++Cs9y+eltW21/cqGofe884AObRhGpcUxfsj/542+txMb3uywYNAQPPsx2yH2v1OQ6cbRMhe9PVIM5eRNzeQkabI0PsQa/CXOet1nzb8W4ShCbGJ+uWUcefDUpPpG/igpRtRBBB/Lcv2n1vsxSs/fYdG3nM386EunZrLYYOwF3fPwJWVEir+p0yFdctYB+rire4U9ft/GZdQg7mA5NK68w0YnpGk2n8BqP6DtPCueoiq6FBjfDeEhX0RjSarhnkK/bcQ== X-YMail-OSG: eTofb2IVM1maeFVBOF7ilVXQySYhmOiN7hdXuxj2OzUZECqhk3eWEvxOlADqNiB g8VrK_zKbbfGyO5XNYex_Tb.FnHwo4f2xqi9ElJOlL_zdjUiH.SLvDlqRVwN1asjJwCieGRbeeuW cE.IRgoqq6ESL1QY13pC_UoSK8mG52K2tGDCT02_WswwvQtjgWalkY0Q2a4uyt_trPp0n5RI0TXq PQRxweOKjy_RaWDjkkFqvxpOX9sdR1RMdC_GesmgOoI17mTIEnwsJ_MsJTyLYn8p.TF1d6KOwjDN njJz8SxoWuJelgkHgcXatplnk9gG3z8Y6O6ju3TZZ0FSfubd5n6q4jd2aPf4fcNiQVfNjwOqDbx3 5MhLhV7noowSRYAIoEIMxOrsN9rSy385GBUbdVvMDuKGt4JXi.wxfk172ONizXiAc8CsJDgdTs.C 1xawtubU44zMnX3JQTQiehS6zn4Y41f8_qscIsM.nz6xMYu4w_Uj3zYzu1asnagE.Nt1DIFoZnPR evvTxL_VKhjX44n7tPmuESi1v2b0FQp4mjAd37MVEZk5.zyDs6N0wRzoXn6kyRbJj1qpKo0soV12 _IYwINrQmAfoh5nJ6oHywbgBX7xZOE8lNWDf42SkwhYmbXuGoMKCHvMWimWbJIrTwqBCqViXGQbD 2iwZXORLowqJwpdOHEGpNehAvKXVKPwnEfOj67ZGEfYrS7AzsmWAm0enQ34pNPdavqJw0m4l4FDZ hs6Q2FprjO8rrf1SuFosGsZjL_xx0Wg.9ILw6hoQ82oi8z6h308nsG0kjMuOtSqGcBX0anKL3mHG E_CSZF64x4aGwzXxtzXpHYHORvSRwxSvxuZ0QwhBesrVPoHv3ox1mXAqW3g1R1jFJNLgFN4Y7GwR 4nRuS5eiCjlyxg5fRIr8.SU6_Jtrv6GZRd7hXs6rFfp7PL1gAN2Z6bCYjEMm9ree65bcw6E2dWwi .7J2ZvEiinkJl8DNwZJo2E1F9iEg5SL70lvgaSC9j3TAyoHHk6Z30XXmrZ9ocWH4KOjrB3vaoXOI BicqQ2h0JzaE6eY1pukGoIBkqds2oRkuNUKgphvzjC2zP79.jbGE7zXEUr.jcD5J2iVlFjqu7I3C rzguO9jVKI3aGHq4NAAFFMeJbOKmnQbD0utcV5W9e_epq.RHeNbG3npW4.RmMSUbcicg00FBtczG HakyijZOGzQbQJDdEOTgMIEnnD6Xtg6yQqNebwpvd1NXvWCzAn04YQ.aeF8tRpJRiOJTWwz3tfH_ F2Bgh1ZrRdY20_0RWZF_e73cocx7wVP7tChNEPwn5bJedtmgA_R4mOx1V3p8TKIw4S6gmPW81sqB GbI2KVvtXytB2P_r3bbjhuwkZVHJRdpQYptm8TmTKPueFBp3OcFcOmGNIC9f7AzNmCqS.d_OZ8xb nfsw06bpCVSBBmux0wJdxWLTLWcnc_Ky_LQGybp1ihnoxosu2s_Leoy2Z86rTEniBqJGzMmug3qw 1YPS9Ef2Gbx3W0TQQbR1WNEILyosL_dOeDdoD62VFrmm8c6X8VP.Wq2td Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.bf2.yahoo.com with HTTP; Mon, 19 Oct 2020 22:20:07 +0000 Received: by smtp406.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 02848635d77766cff27b27c6563dd746; Mon, 19 Oct 2020 22:20:06 +0000 (UTC) Date: Mon, 19 Oct 2020 18:20:04 -0400 From: Aim To: freebsd-questions@freebsd.org Subject: fresh build of shotcut dumps core Message-Id: <20201019182004.bbb8c35bdc695dfdf3254cd2@aim.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <20201019182004.bbb8c35bdc695dfdf3254cd2.ref@aim.com> X-Rspamd-Queue-Id: 4CFWQw3jwzz4GvQ X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.61 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[aim.com:s=a2048]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[aim.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.014]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[aim.com:+]; DMARC_POLICY_ALLOW(-0.50)[aim.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[74.6.129.82:from]; NEURAL_HAM_SHORT(-0.10)[-0.101]; R_SPF_ALLOW(-0.20)[+ip4:74.6.128.0/21]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[aim.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions]; RWL_MAILSPIKE_POSSIBLE(0.00)[74.6.129.82:from] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Oct 2020 22:20:12 -0000 Debugging this is above my pay grade. I am going to give openshot a try #0 0x000000080a572d96 in () at /usr/local/lib/dri/i915_dri.so #1 0x0000000801490d28 in QSGBatchRenderer::Renderer::renderBatches() () at /usr/local/lib/qt5/libQt5Quick.so.5 #2 0x0000000801493296 in QSGBatchRenderer::Renderer::render() () at /usr/local/lib/qt5/libQt5Quick.so.5 #3 0x000000080147ad61 in QSGRenderer::renderScene(QSGBindable const&) () at /usr/local/lib/qt5/libQt5Quick.so.5 #4 0x000000080147ab09 in QSGRenderer::renderScene(unsigned int) () at /usr/local/lib/qt5/libQt5Quick.so.5 #5 0x00000008014dfff6 in QSGDefaultRenderContext::renderNextFrame(QSGRenderer*, unsigned int) () at /usr/local/lib/qt5/libQt5Quick.so.5 #6 0x0000000801545048 in QQuickWindowPrivate::renderSceneGraph(QSize const&, QSize const&) () at /usr/local/lib/qt5/libQt5Quick.so.5 #7 0x00000008015d720c in QQuickRenderControl::render() () at /usr/local/lib/qt5/libQt5Quick.so.5 #8 0x000000080085c420 in () at /usr/local/lib/qt5/libQt5QuickWidgets.so.5 #9 0x0000000800cd5b3f in QWidget::event(QEvent*) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #10 0x000000080086035a in QQuickWidget::event(QEvent*) () at /usr/local/lib/qt5/libQt5QuickWidgets.so.5 #11 0x0000000800c9aae0 in QApplicationPrivate::notify_helper(QObject*, QEvent*) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #12 0x0000000800c9c09c in QApplication::notify(QObject*, QEvent*) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #13 0x000000080544d2a2 in QCoreApplication::notifyInternal2(QObject*, QEvent*) () at /usr/local/lib/qt5/libQt5Core.so.5 #14 0x0000000800cce36e in QWidgetPrivate::sendPendingMoveAndResizeEvents(bool, bool) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #15 0x0000000800cd4637 in QWidgetPrivate::show_helper() () at /usr/local/lib/qt5/libQt5Widgets.so.5 #16 0x0000000800cd4a32 in QWidgetPrivate::showChildren(bool) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #17 0x0000000800cd4659 in QWidgetPrivate::show_helper() () at /usr/local/lib/qt5/libQt5Widgets.so.5 #18 0x0000000800cd4a32 in QWidgetPrivate::showChildren(bool) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #19 0x0000000800cd4659 in QWidgetPrivate::show_helper() () at /usr/local/lib/qt5/libQt5Widgets.so.5 #20 0x0000000800cd54e5 in QWidgetPrivate::setVisible(bool) () at /usr/local/lib/qt5/libQt5Widgets.so.5 #21 0x000000000032f622 in () #22 0x000000000032f10f in () #23 0x0000000800569000 in () #24 0x0000000000000000 in () -- From owner-freebsd-questions@freebsd.org Tue Oct 20 03:36:24 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D980744428E for ; Tue, 20 Oct 2020 03:36:24 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [IPv6:2001:470:0:19b::b869:801b]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.holgerdanske.com", Issuer "www.holgerdanske.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFfRq4Cg1z3S6j for ; Tue, 20 Oct 2020 03:36:23 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from 99.100.19.101 (99-100-19-101.lightspeed.frokca.sbcglobal.net [99.100.19.101]) by holgerdanske.com with ESMTPSA (TLS_AES_128_GCM_SHA256:TLSv1.3:Kx=any:Au=any:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Mon, 19 Oct 2020 20:36:14 -0700 Subject: Re: FreeBSD using swap even though there's a lot of free memory To: freebsd-questions@freebsd.org References: <5f8d9d5e14b4c_dad82b12ba6585a44346f@sirportly-app-01.mail> <20201016195748.ffc15759b311a5feefc91ef5@sohara.org> <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> <5f8dad6c5225e_11f782aaeb993e5bc705b@sirportly-app-01.mail> From: David Christensen Message-ID: <31b3314a-b035-305d-4136-18bc690fa6ae@holgerdanske.com> Date: Mon, 19 Oct 2020 20:36:10 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <5f8dad6c5225e_11f782aaeb993e5bc705b@sirportly-app-01.mail> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CFfRq4Cg1z3S6j X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of dpchrist@holgerdanske.com has no SPF policy when checking 2001:470:0:19b::b869:801b) smtp.mailfrom=dpchrist@holgerdanske.com X-Spamd-Result: default: False [1.86 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.32)[0.317]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.46)[0.461]; ARC_NA(0.00)[]; NEURAL_SPAM_LONG(0.18)[0.180]; DMARC_NA(0.00)[holgerdanske.com]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2020 03:36:24 -0000 On 2020-10-19 08:14, Twingly Customer Support wrote: > The following are the updates that was installed last Friday, which seems to have solved the problem: > > New packages to be INSTALLED: > bash-completion: 2.11,2 > glib: 2.66.0_1,1 > postgresql12-client: 12.4 > > Installed packages to be UPGRADED: > bash: 5.0.17 -> 5.0.18_3 > ca_root_nss: 3.56 -> 3.57 > fio: 3.20 -> 3.23 I'm glad the problem went away. :-) Updates and upgrades have broken my systems more times than I care to remember. Now, I take an image of the system drive before upgrading a machine. If an upgrade misbehaves, hopefully I will catch it quickly and can simply go back to the previous image. Otherwise, I need to include backup/ restore of system configuration files and/or data when re-imaging. Perhaps you should consider setting up a staging/ testing environment, update/ upgrade that, and run tests. If everything looks good, then upgrade the production environment. The length of your 'pkg upgrade' output suggests that you might want to upgrade more frequently. This should give you a smaller haystack to search if and when an upgrade causes problems. All of the above might be facilitated with virtualization and/or automation. David From owner-freebsd-questions@freebsd.org Tue Oct 20 12:09:22 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3CE3742F8CB for ; Tue, 20 Oct 2020 12:09:22 +0000 (UTC) (envelope-from freebsd@jschneider.net) Received: from slave.jschneider.net (slave.jschneider.net [46.235.226.89]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFsqj3Ryfz4Fj6 for ; Tue, 20 Oct 2020 12:09:21 +0000 (UTC) (envelope-from freebsd@jschneider.net) X-Disposition: Mostly harlmess; Tue, 20 Oct 2020 13:09:07 +0100 From: Jon Schneider Subject: Pool space inconsistency To: freebsd-questions@freebsd.org Message-ID: <76ce98a6-f561-a997-7512-d2ce96f250bb@jschneider.net> Date: Tue, 20 Oct 2020 13:09:00 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.12.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CFsqj3Ryfz4Fj6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@jschneider.net designates 46.235.226.89 as permitted sender) smtp.mailfrom=freebsd@jschneider.net X-Spamd-Result: default: False [-2.54 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.86)[-0.862]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:46.235.226.89]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[jschneider.net]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.995]; NEURAL_HAM_SHORT(-0.38)[-0.378]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:44684, ipnet:46.235.224.0/21, country:GB]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2020 12:09:22 -0000 zpool list says NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT zroot 1.81T 1.68T 137G - - 45% 92% 1.00x ONLINE - whereas zfs list (and df -h) claim 79GB available. NAME USED AVAIL REFER MOUNTPOINT zroot 1.68T 78.9G 88K /zroot How does the discrepancy between 137GB and 79GB come about ? Perfectly default dataset arrangements with no reservations on 11.2 . Jon From owner-freebsd-questions@freebsd.org Tue Oct 20 18:11:09 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 393A04374FA for ; Tue, 20 Oct 2020 18:11:09 +0000 (UTC) (envelope-from pprocacci@gmail.com) Received: from mail-pj1-x102b.google.com (mail-pj1-x102b.google.com [IPv6:2607:f8b0:4864:20::102b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CG1s8240Gz4bF9 for ; Tue, 20 Oct 2020 18:11:07 +0000 (UTC) (envelope-from pprocacci@gmail.com) Received: by mail-pj1-x102b.google.com with SMTP id kk5so842664pjb.1 for ; Tue, 20 Oct 2020 11:11:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=cQwBtyHRxV1aBNkiZCI6DwrV27DZ8WclTbQMHlrxCPc=; b=F/ZRKTnDNuRAA8rncbS4RgmRVvK9ph7w8R2eTjB7HNDJVC0jkyQjM1G7/kg8lCqIyO p+0YyttTWa53OW6YG+iiG1iad7tzE5mUp/zPq5kuhMey/q8/ekQBmU0jB1bjofFYnFgW uOkN7Ot0+A8eMVfPz3IHYoyr77KN4T427mFaFV/kMUfqJKNDTx31vS1tqt/FTJw5uKLa sJFQD1GNm2ASxp1fy55IZmzy6VF7ND72hYUHYtoxO9PVFvt2/CntMKUkCUOjhyiIS+Jw LGZMz9fZNEBQM3n1k/fV3EK+CNru9v7NlVw0mnXf+KwJetTSdp1LI8ZhUWchBI9e5KLC nxyQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=cQwBtyHRxV1aBNkiZCI6DwrV27DZ8WclTbQMHlrxCPc=; b=d5EHrzOzeLr153XEr5DaOyvabwmTdm7cTs253V2QIb948ciY5gG1yYscITVQUil4Ih xIbFdaje8ZLkzBMxAFMOPOS++Zehm1jfWt9n33FNyPehHD6EGWiQhJjUG13PI4+ZCGTY Z8BgWj7KiG9r2IQUsiSrLA3sVBz5su5mypaMLXRQpaFSFEje9VGi+gMkQq9Pq8Emy4X+ Toh0wiMR2YWcHfb9KWc+SgEyMvtGct2PCgIQtaXEEbRL8XXs8lWELK1EZQAkyPnWPdfL HaK3jYij0mzZgQvXkhcJyPpbxv0QZh7q0JsHF+ukHYL9G9Zlx22a9sgj8FsiEf+LM4MS MeEg== X-Gm-Message-State: AOAM533n6iDZa77N/eQ4lEelmoEmC5J86xlUC88hYXOa6twSNSKO86Fr bouh3KPPas4uWmkf5Ob+/G5mLYfljQyLFazrp9izJcnMfp5+ X-Google-Smtp-Source: ABdhPJyA8vj5Kft7bRTeIuQV4mnkh5oPWdz5NUSm9cSGTkq5pDhrC5UEPTq45qPYG5z/4z7hZzcykYRYuQfHmkoUUtc= X-Received: by 2002:a17:902:aa94:b029:d3:b593:2736 with SMTP id d20-20020a170902aa94b02900d3b5932736mr4219661plr.57.1603217466325; Tue, 20 Oct 2020 11:11:06 -0700 (PDT) MIME-Version: 1.0 References: <76ce98a6-f561-a997-7512-d2ce96f250bb@jschneider.net> In-Reply-To: <76ce98a6-f561-a997-7512-d2ce96f250bb@jschneider.net> From: Paul Procacci Date: Tue, 20 Oct 2020 14:10:40 -0400 Message-ID: Subject: Re: Pool space inconsistency To: Jon Schneider Cc: freebsd-questions@freebsd.org X-Rspamd-Queue-Id: 4CG1s8240Gz4bF9 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=F/ZRKTnD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of pprocacci@gmail.com designates 2607:f8b0:4864:20::102b as permitted sender) smtp.mailfrom=pprocacci@gmail.com X-Spamd-Result: default: False [-3.28 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.010]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.010]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::102b:from]; NEURAL_HAM_SHORT(-0.26)[-0.258]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2020 18:11:09 -0000 This disparity is describe in the zpool man page. " The space usage properties report actual physical space available to the storage pool. The physical space can be different from the total amount of space that any contained datasets can actually use. The amount of space used in a raidz configuration depends on the characteristics of the data being written. In addition, ZFS reserves some space for internal accounting that the zfs(8) command takes into account, but the zpool(8) command does not. For non-full pools of a reasonable size, these effects should be invisible. For small pools, or pools that are close to being completely full, these discrepancies may become more noticeable." ~Paul On Tue, Oct 20, 2020 at 8:09 AM Jon Schneider wrote: > zpool list says > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > HEALTH ALTROOT > zroot 1.81T 1.68T 137G - - 45% 92% 1.00x > ONLINE - > > whereas zfs list (and df -h) claim 79GB available. > > NAME USED AVAIL REFER MOUNTPOINT > zroot 1.68T 78.9G 88K /zroot > > How does the discrepancy between 137GB and 79GB come about ? > > Perfectly default dataset arrangements with no reservations on 11.2 . > > Jon > _______________________________________________ > freebsd-questions@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to " > freebsd-questions-unsubscribe@freebsd.org" > -- __________________ :(){ :|:& };: From owner-freebsd-questions@freebsd.org Wed Oct 21 06:53:18 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E14DD444920 for ; Wed, 21 Oct 2020 06:53:18 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.17.10]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CGLmY5Gybz3gXt for ; Wed, 21 Oct 2020 06:53:17 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r56.edvax.de ([94.222.202.172]) by mrelayeu.kundenserver.de (mreue107 [212.227.15.183]) with ESMTPA (Nemesis) id 1Mjjvp-1k1akJ1Gxf-00lEfO; Wed, 21 Oct 2020 08:53:08 +0200 Date: Wed, 21 Oct 2020 08:53:07 +0200 From: Polytropon To: David Christensen Cc: freebsd-questions@freebsd.org Subject: Re: FreeBSD using swap even though there's a lot of free memory Message-Id: <20201021085307.5a5ec9cb.freebsd@edvax.de> In-Reply-To: <31b3314a-b035-305d-4136-18bc690fa6ae@holgerdanske.com> References: <5f8d9d5e14b4c_dad82b12ba6585a44346f@sirportly-app-01.mail> <20201016195748.ffc15759b311a5feefc91ef5@sohara.org> <5f885b772d622_95aa2adab2b9c5b41576495c3@sirportly-app-02.mail> <5f8dad6c5225e_11f782aaeb993e5bc705b@sirportly-app-01.mail> <31b3314a-b035-305d-4136-18bc690fa6ae@holgerdanske.com> Reply-To: Polytropon Organization: EDVAX X-Mailer: Sylpheed 3.1.1 (GTK+ 2.24.5; i386-portbld-freebsd8.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:TubRACOdHY8NQyUsFA3Y1HIEueJwh38kGue/YarPVRaoGQinMbP lnXRKLkyZs/40ftwjJWzQ6qaCiaWFA2x2C8yN//n5EDNOa++jDFuIk92zR71J6A8PBqT+g0 wUtK5wc86w3LSVAqgN1tt8xYvU63YGnx6RLGMNL5qSi6JIUPG9Ug2+l3ILsoQOEsMwmrhaG qUAQYEFSMXqnBUHawjDTg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:y1QYTXtml+g=:ms4jLGekpYiyrfbAxaq9sX bx9k2GnXpNZJ3DwFKG1nKyVG+Uph9mgZkg76PZpLh67HETGoUuVQ2ROznfoz7FMvixwYI0Los Wo4LPeB1rf0cqqu0Bbg1MW2yVIE5OyuYxRk7JYo35cOyCHgAWeRtz5yULsJDdofhQVUCe/zny WpbBPTQ+KagqC+LU89k64o+UqoKFb5k90GrCZwddW8Kyfk3v2i9VjDCBXiuSjts8yGKJRNC72 cfjcSq9jbTJwVra5bBJjNEjM9/CcRIEdZstLWaFZKSwtpAhwuoQIGlArz6I2qe0onAyFLpHHQ kflhVapDU+lXRRklZdxt+/ZqOPRk9VHnMXYC96XQwVdP4ot9g+O8YVKypVd8SB0+9bhrkQanf viaHXr31YTNRujUMF7vMHxeuLGI0cGLete8h66nloDhBmIPaBrGlxRoon24f+ X-Rspamd-Queue-Id: 4CGLmY5Gybz3gXt X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@edvax.de has no SPF policy when checking 212.227.17.10) smtp.mailfrom=freebsd@edvax.de X-Spamd-Result: default: False [2.65 / 15.00]; HAS_REPLYTO(0.00)[freebsd@edvax.de]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; HAS_ORG_HEADER(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RECEIVED_SPAMHAUS_PBL(0.00)[94.222.202.172:received]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.21)[0.208]; NEURAL_HAM_LONG(-0.00)[-0.002]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[edvax.de]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.04)[0.041]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_CONTAINS_FROM(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[212.227.17.10:from]; R_SPF_NA(0.00)[no SPF record]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.10:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Oct 2020 06:53:18 -0000 On Mon, 19 Oct 2020 20:36:10 -0700, David Christensen wrote: > Updates and upgrades have broken my systems more times than I care to > remember. Now, I take an image of the system drive before upgrading a > machine. If an upgrade misbehaves, hopefully I will catch it quickly > and can simply go back to the previous image. Otherwise, I need to > include backup/ restore of system configuration files and/or data when > re-imaging. This is a great opportunity to integrate ZFS-based BEs (boot environments) into the workflow. They allow you to easily revert back changes caused by updates if required. > Perhaps you should consider setting up a staging/ testing environment, > update/ upgrade that, and run tests. If everything looks good, then > upgrade the production environment. This is also possible, and often a good suggestion, if you can actually create such a "secondary environment"; if you have to do everything in "live mode", BEs are probably the best solution. -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-questions@freebsd.org Thu Oct 22 03:55:43 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ABA4543CFA5 for ; Thu, 22 Oct 2020 03:55:43 +0000 (UTC) (envelope-from bourne.identity@hotmail.com) Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-oln040092071065.outbound.protection.outlook.com [40.92.71.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CGtnB0tdWz4Hf9 for ; Thu, 22 Oct 2020 03:55:41 +0000 (UTC) (envelope-from bourne.identity@hotmail.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=jGelSGvY5fD+1TIjQ2xmXxvDHRXNn7dm3MHNjHLsrH1wh7HbO1xa1Qd9HCh1p1yHY5Dn7Oko63TKfi0mC6bVTN5yw051hlVOMR/+fEO/QpO/gN41wLJYqv36Eo2l09C4sosfSX2x3WyMLC+7+d82aAqf4AhT7MNXxyPWdRNE0A7OgL/J55Ez6nzCVtNsASi3dExmhmFKfFR1R1w52TCYWkKNvaUHiTjavF1zuwwzXM4+D6AmfLcS1MKgQFiBR8mf/Py8xJAmogcuVKgai988ffS5k1nDfiN+F9gRQ/AxDB6fFOONsn3WVubsD8MVtsVwuDu6FHh0qs/LShi6/7KKUg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LxrNWJqYuycy2B8XiHDi/WqaCBGDQAs3dF6KZ2Ev0F4=; b=OCdU3in7Z00p07JEjBSGrSA7esnRnP6Zw9y7Cj2K6iQ/Ms+dLtVqMFbXOp8xx+AzFjYNR4mNzWUaPxy10dAP9+0Y20Sx6NQJxm1WkFiEVOf0ydQVkOOqvNuEH4A5iMgixvLjBS5aphhFOY8umVYxXKP7VqPjYsFr1b7qYAiSxCjX0x2TJTP4RE6ejD4eKPjZvbFjmu3VJHzLWHBHESVmvEp+Okic96LsRWPQiILYGfRcmL312vl9UmQVR2+32ChCWT+m+xdKxQ19T89TEKFahqZpIQThO+wVcMdKgE46jsJSJKCih0CQFjOqu4pcAOUalZzpUnU/jEsL+V0bu1PYVQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LxrNWJqYuycy2B8XiHDi/WqaCBGDQAs3dF6KZ2Ev0F4=; b=MABBZ9GRZ+TcSBtcicTtMEvBCp/hjiTfRPNdpPJxcoc0apricjRIt6gMLHvgZIcD1cXKDL+bV6Xs5dPHkJQLFOna/yDiaMfP372QJzzxOWEK7qJDOa5Ucb1O6jkOEeZ1EF63SHbTEhOGi4gEjx2rJ99nMUGQr7qBmvXNp4/g0wTG2nuDAPSBPV9co9rQXIISBPZa6oCcjFaoKo5+wTE3/qWiksZZZMosnMyk7W+68pWYcalCtaUlVHG7GrQoKVSP6yl1iH53BUHEYiTKYQjtrMXsdwm0wIMJnQePOn1o/objjSL2GFh+pgxbgXvjHPVCxbSkz3CJRYievKsq5vl9cQ== Received: from VE1EUR03FT052.eop-EUR03.prod.protection.outlook.com (2a01:111:e400:7e09::4b) by VE1EUR03HT225.eop-EUR03.prod.protection.outlook.com (2a01:111:e400:7e09::301) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3499.18; Thu, 22 Oct 2020 03:55:39 +0000 Received: from DB8PR06MB6442.eurprd06.prod.outlook.com (2a01:111:e400:7e09::41) by VE1EUR03FT052.mail.protection.outlook.com (2a01:111:e400:7e09::429) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3499.18 via Frontend Transport; Thu, 22 Oct 2020 03:55:39 +0000 X-IncomingTopHeaderMarker: OriginalChecksum:A33021666BB5BE2769A93DBC6DF23F738F130C9C563ADCB375FC89D8B58B5670; UpperCasedChecksum:ECCAB076F299BB66117AF930CB217BF16DF93E1AC5447090C53646487B478A69; SizeAsReceived:8495; Count:45 Received: from DB8PR06MB6442.eurprd06.prod.outlook.com ([fe80::5822:2d5d:a176:574f]) by DB8PR06MB6442.eurprd06.prod.outlook.com ([fe80::5822:2d5d:a176:574f%9]) with mapi id 15.20.3477.028; Thu, 22 Oct 2020 03:55:39 +0000 To: FreeBSD From: Manish Jain Subject: Can somebody please look at PR# 250243 ? Message-ID: Date: Thu, 22 Oct 2020 09:25:34 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-TMN: [1WkO6+ZQ3R+Q/lap5io2G7e3lXt2bmof] X-ClientProxiedBy: BMXPR01CA0090.INDPRD01.PROD.OUTLOOK.COM (2603:1096:b00:54::30) To DB8PR06MB6442.eurprd06.prod.outlook.com (2603:10a6:10:126::7) X-Microsoft-Original-Message-ID: <1746aa0a-a1a7-4be1-b47a-8919401505b3@hotmail.com> MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [192.168.1.2] (45.127.45.217) by BMXPR01CA0090.INDPRD01.PROD.OUTLOOK.COM (2603:1096:b00:54::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3499.18 via Frontend Transport; Thu, 22 Oct 2020 03:55:38 +0000 X-MS-PublicTrafficType: Email X-IncomingHeaderCount: 45 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-Correlation-Id: e8afa338-6ded-44ce-b27a-08d8763e56f6 X-MS-TrafficTypeDiagnostic: VE1EUR03HT225: X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: GH6I8124LQ3yAaMIcqJD5hQuDTKFM6lzDdvPTiliazha2IpTfUjaiDw4/sIavsax2HWXtdx9WVEbHK7abfEKo1aIbn053xzZ4JPL7Z8ejZd+53gijSRZ1pEdbNpA8rUHSHwQMCXWAnwtbCBZ6rN7Cld9dE/2ElPF73HV6QE2gwf4EmkqS9Ol+5rrqS508t8iiFHpREDRcXsMwErrym4YUca4WgRpF7vOp9xLVUvL1XZ/cFJuN7B1ytd4uB29Sq7N X-MS-Exchange-AntiSpam-MessageData: XjU+LeUv+JwinTITmFIo6tQA+uDXTtM0JqcCNwm5gaiNjWlpCtjp0T8vGNHv0Fl517iERj738YN45O6P9krq6Op2KAbsc7syr8iJlyN0pWxHIc4zyVeuErKERge+XayrOrNufDrrfC2iEOHqnPsXyA== X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-Network-Message-Id: e8afa338-6ded-44ce-b27a-08d8763e56f6 X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Oct 2020 03:55:39.4223 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-AuthSource: VE1EUR03FT052.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: Internet X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: VE1EUR03HT225 X-Rspamd-Queue-Id: 4CGtnB0tdWz4Hf9 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=MABBZ9GR; dmarc=pass (policy=none) header.from=hotmail.com; spf=pass (mx1.freebsd.org: domain of bourne.identity@hotmail.com designates 40.92.71.65 as permitted sender) smtp.mailfrom=bourne.identity@hotmail.com X-Spamd-Result: default: False [-1.48 / 15.00]; FREEMAIL_FROM(0.00)[hotmail.com]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[hotmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; NEURAL_HAM_SHORT(-0.85)[-0.850]; RCVD_IN_DNSWL_LOW(-0.10)[40.92.71.65:from]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.80.0.0/12, country:US]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; DWL_DNSWL_NONE(0.00)[hotmail.com:dkim]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.024]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.011]; FROM_EQ_ENVFROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCPT_COUNT_ONE(0.00)[1]; RECEIVED_SPAMHAUS_PBL(0.00)[45.127.45.217:received]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.92.71.65:from]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 03:55:43 -0000 Hi, I moved my port shells/switchBashZsh from GPL to BSD license. For this, I raised a PR on 10 October, 2020 : https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=250243 Since there has been no action yet, I request somebody to please take up the PR. Thank you, Manish Jain From owner-freebsd-questions@freebsd.org Thu Oct 22 13:34:53 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 56BD6448F52 for ; Thu, 22 Oct 2020 13:34:53 +0000 (UTC) (envelope-from jmc-freebsd2@milibyte.co.uk) Received: from smarthost01b.mail.zen.net.uk (smarthost01b.mail.zen.net.uk [212.23.1.3]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CH7dS251Tz3dMj for ; Thu, 22 Oct 2020 13:34:52 +0000 (UTC) (envelope-from jmc-freebsd2@milibyte.co.uk) Received: from [82.71.56.121] (helo=curlew.localnet) by smarthost01b.mail.zen.net.uk with esmtpsa (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1kVajy-0006zW-Af for freebsd-questions@freebsd.org; Thu, 22 Oct 2020 13:34:50 +0000 From: Mike Clarke To: freebsd-questions@freebsd.org Subject: Re: FreeBSD using swap even though there's a lot of free memory Date: Thu, 22 Oct 2020 14:34:02 +0100 Message-ID: <41114958.RqoaopZvpL@curlew> In-Reply-To: <20201021085307.5a5ec9cb.freebsd@edvax.de> References: <5f8d9d5e14b4c_dad82b12ba6585a44346f@sirportly-app-01.mail> <31b3314a-b035-305d-4136-18bc690fa6ae@holgerdanske.com> <20201021085307.5a5ec9cb.freebsd@edvax.de> MIME-Version: 1.0 X-Originating-smarthost01b-IP: [82.71.56.121] Feedback-ID: 82.71.56.121 X-Rspamd-Queue-Id: 4CH7dS251Tz3dMj X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 212.23.1.3 is neither permitted nor denied by domain of jmc-freebsd2@milibyte.co.uk) smtp.mailfrom=jmc-freebsd2@milibyte.co.uk X-Spamd-Result: default: False [2.85 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.23.1.3:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.88)[0.885]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.64)[0.635]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_SPAM_LONG(0.53)[0.530]; DMARC_NA(0.00)[milibyte.co.uk]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:13037, ipnet:212.23.0.0/19, country:GB]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7Bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 13:34:53 -0000 On Wednesday, 21 October 2020 07:53:07 BST Polytropon wrote: > This is a great opportunity to integrate ZFS-based BEs (boot > environments) into the workflow. They allow you to easily > revert back changes caused by updates if required. Well worth doing. That approach has saved my neck a few times when things have gone pear shaped with dependency issues after pkg upgrade has reinstalled a few hundred packages. I normally create a new BE and chroot into it to do the upgrade. That way the running system isn't interrupted even if the upgrade goes disastrously wrong. If the upgrade looks OK it's then just a case of rebooting with the new BE at a convenient time. -- Mike Clarke From owner-freebsd-questions@freebsd.org Thu Oct 22 15:23:02 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C569F44AE6E for ; Thu, 22 Oct 2020 15:23:02 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: from mail-qk1-x72d.google.com (mail-qk1-x72d.google.com [IPv6:2607:f8b0:4864:20::72d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHB2G0slCz41sf for ; Thu, 22 Oct 2020 15:23:01 +0000 (UTC) (envelope-from luzar722@gmail.com) Received: by mail-qk1-x72d.google.com with SMTP id 140so1809639qko.2 for ; Thu, 22 Oct 2020 08:23:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:date:from:user-agent:mime-version:to:subject :content-transfer-encoding; bh=aIujgwMx7zddkjtHCEu/nTgy65S0tHeBaurifIUnDDs=; b=f65SwXx6IZQINb0hWiznQyb8XRFMQYxCIGtv+8v0GF4x6AWpV3oZkV6ze+6LN2uZXq 2pi9CbX+elccFQM9qmKYIBarnNlnPBo165aTH4fTn75WAVF6sP9yZCT8pgNoEbXZ763+ 8ucYzzLJkG/kijYdmKcUQ+pSwfv8XbhJee+DOqwFk7bw7AvozMAnMIOJgKSTq+XewaTr vNOL3DfLV3+7pOJPT7zpFt35x7Oa4GGpA/Zm0o3p3P7YELj94VbiGrtW9vivk85l/GyC YgITaybKiz9Ocpv7RZUkYDC4pONeatXOA6zq3PKLalzsoBjFxPFnRvU4W3g/mhx79npD 7gpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:content-transfer-encoding; bh=aIujgwMx7zddkjtHCEu/nTgy65S0tHeBaurifIUnDDs=; b=uESOsE6mMstx52Ic5nRovMN+JXDx8CBgh0YxFHrvHHzzbrEjigLG/mM4+7W38hqWeb OYuEAeNMWNelfsGvtCcJetHwPvnhZ//NMUgwx+OgIco8C+TU086p7IDLNu2UaxgLcMTB lHIQkOsl6RhQc5HU3Yeq6+Iitkhw+a+VujEMsaolYbLuS0hR534Kp/0syfWh9fwG1AxW xDuIhE2MwO2IOlAUMvQD5rmPUEzEXhqzdYVFIOfu00tdHypmwHWhbXo9MyzPkPer/U5D Sp+cOSKTuyAfZAHUUbbk2Q7c6IVl3GtSBhFL3sDimGhMP/30fZyPZjUcAHOWrGlBOcow ExVg== X-Gm-Message-State: AOAM530UcL2DYPBxc7gVyQCR3QG5hz0v9MN6m3OaeD/vH978/ysdvjrK 5rJnU/dhVW+qlMRJ/edcf3WBbWsysvg= X-Google-Smtp-Source: ABdhPJzSTX9LIh4Hq8eaiqYBeeAvk23GS9k40dlHJGiiYARVFBSraYPNc79kXwDUl/PI2m14R4cAXw== X-Received: by 2002:a37:c441:: with SMTP id h1mr1414070qkm.298.1603380180564; Thu, 22 Oct 2020 08:23:00 -0700 (PDT) Received: from [10.0.10.8] (cpe-65-25-51-0.neo.res.rr.com. [65.25.51.0]) by smtp.googlemail.com with ESMTPSA id z26sm1213428qtb.85.2020.10.22.08.22.59 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 22 Oct 2020 08:22:59 -0700 (PDT) Message-ID: <5F91A3D3.7010304@gmail.com> Date: Thu, 22 Oct 2020 11:22:59 -0400 From: Ernie Luzar User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: "freebsd-questions@freebsd.org" Subject: How to get to base.txz in the install image file Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CHB2G0slCz41sf X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=f65SwXx6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of luzar722@gmail.com designates 2607:f8b0:4864:20::72d as permitted sender) smtp.mailfrom=luzar722@gmail.com X-Spamd-Result: default: False [-3.83 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.81)[-0.808]; RECEIVED_SPAMHAUS_PBL(0.00)[65.25.51.0:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.010]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.008]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72d:from]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 15:23:02 -0000 I want to target the base.txz file in the release.img install file. After downloading the release.img file how do I open it and point to the base.txz file? Is there a way? From owner-freebsd-questions@freebsd.org Thu Oct 22 15:56:30 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1155744BD71 for ; Thu, 22 Oct 2020 15:56:30 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHBms6S8Qz43vw for ; Thu, 22 Oct 2020 15:56:29 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [81.2.117.100]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: matthew/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 94317193EE for ; Thu, 22 Oct 2020 15:56:29 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from PD0786.local (130.31-255-62.static.virginmediabusiness.co.uk [62.255.31.130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: m.seaman@infracaninophile.co.uk) by smtp.infracaninophile.co.uk (Postfix) with ESMTPSA id DB1BF1BEBA for ; Thu, 22 Oct 2020 15:56:26 +0000 (UTC) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none (p=none dis=none) header.from=FreeBSD.org Authentication-Results: smtp.infracaninophile.co.uk/DB1BF1BEBA; dkim=none; dkim-atps=neutral Subject: Re: How to get to base.txz in the install image file To: freebsd-questions@freebsd.org References: <5F91A3D3.7010304@gmail.com> From: matthew@FreeBSD.org Message-ID: <9fbeecd1-4da2-ae84-68fa-1a212c2ab635@infracaninophile.co.uk> Date: Thu, 22 Oct 2020 16:56:13 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.12.1 MIME-Version: 1.0 In-Reply-To: <5F91A3D3.7010304@gmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 15:56:30 -0000 On 22/10/2020 16:22, Ernie Luzar wrote: > I want to target the base.txz file in the release.img install file. > After downloading the release.img file how do I open it and point to the > base.txz file? Is there a way? You can just download base.txz direct from the FreeBSD FTP servers. eg: http://ftp.freebsd.org/pub/FreeBSD/releases/amd64/12.1-RELEASE/base.txz That's the same as goes into the release images. Make the obvious substitutions for different CPU architectures or release versions. To answer your actual question: try tar(1). It can read a lot of disk-image formats. Not sure about the .img file, but it can certainly read .iso images. Cheers, Matthew From owner-freebsd-questions@freebsd.org Thu Oct 22 19:02:26 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 83C8A44FD3F for ; Thu, 22 Oct 2020 19:02:26 +0000 (UTC) (envelope-from pr0f3ss0r1492@yahoo.com) Received: from sonic307-2.consmr.mail.bf2.yahoo.com (sonic307-2.consmr.mail.bf2.yahoo.com [74.6.134.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHGvP1jglz4NCt for ; Thu, 22 Oct 2020 19:02:24 +0000 (UTC) (envelope-from pr0f3ss0r1492@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1603393343; bh=a99mdN/jYLJZ2x2lxKuhGq8WNOg4bo8NLgwYryPXaDa=; h=To:From:Subject:Date; b=JccXj9nFuRcpO1vHpYLV+fTwYp4fikjgVJDurfRIQthClX3w0z92ly4szZv7aBXvB2WLjyl/d79ATajFgjVr7+qryfeJUurXVYFpKP9TdE/nHPqtCi0gSdGTm5lnC6vKVsrrUxemRvG6oQzJeppsvkcbkL+mg15cjUqX9zNkh/9eiIYe4aJR+o5dnA0HjOp3X35iMdF9Ysx5iBDCDZ3ev+NMlZvRytnNJvEJpzGi87Nm44tNNuggesWaAFcYx7MhFdBuCPXfPHEHirgPpbmhZ14sPpft/56hHMgxpHPCfw7+4N6Fur0kVTeXVYfUeu4dRACvacoIeRmsHdUQD+WMTA== X-YMail-OSG: z5wZs5MVM1l7GZ1IRa3dfp1fnNejoHiUCHVjmBNureTv1Ex84IV1NMTlRf_6h3I yNtDDhbNmMDp4PhCRZ8m.oQ0RnKYt.snzyf7f2KxVXBGY8F7X3ZNxK1_ZRuqURm0bmNE0byIC4Kj 4dGRRVQoy1HKA18WChykHiEmn__b7m_dfTPRzqhOatyNZTR9qJhuRCYFMOHuadTnB2f4phWTkcHH 2UlFQpqh.DwhBfL6lGFhS3YrsiQw7WRP52bOhUO_baJyvV39P06Pkr6gQxYJa5kR_oujgf9FdOL. VZbzhSQuqb0eVaqOe2iTfgid0wwln3QfgwnEuWl.El8TQp0mJUTaHEH91TEvKts6hzF1W_k1p27t 8qI9k7KwEaXlmYq4ZNzHamKZ7qM6g1OksZ368hmTl.qlCEms8KRASXi71.aD.p3oKwRbMR72kuka LhBrhwxM.cPknnrjRuXD0nAfApl13wfLr9WbI5KlnDgHahVY8P0zpiAidmVWEQUrGGw69b8yt50G hZrCIkT1jWqha.b3ixBCaEs49bxUkznNJBkDsv4.tDwcgo2d4dBSyMNgLdvcgvzQd.5LXEyj477a zsqspmA7rkaAITSxi6jSVCqyytAEVV6zXra16t9OhUCjCa4phq9NMq2Dgw7a6Aky2MapPgbpen5Y g_p9q9NHu11aESo9gdI38kKRGJaSzjBrcTTd.P_3xNIixMKnuLmnmA_mB9tZ6NV7_QV3WJ5E0n_c NVwl7po1eZZpomN9lEJ0cgZy6fopFV9lfgXR378ODytrfgWUjJ9b2ik3hXFLih6WBNI.kbiAJo3I ladKGXVhRHK42jerxGmFvJsRuHJbchbaWYeeP80WfjIF_8oI_UBCmT1p4zL9stxMQlIdBYEUanVu pDtqxCuaj7JLsIgSe9ZiJj6OpCflFqLkDU1q4dXKoAcdFcu9Gcq6_TtvQNaBaDhLVnNkJtMNqv_O Qu2kPxaSHcDE_OFoy5ctOE8uvFGIkuest5Xx54MYmtfip3mWvd3qcKaRRuVhfDXVPHmltxUnTKPD _BCoaYtKGShu2HcKjGA2gY9IFTTa7S.WN45FAk6jwK8NFaKJlRm21UxeZvjNeoE1wkyS1c2r4dS9 CJd0S2lMgQZKfAXIJo3nuYY6cJfmJgkIWU1OJoXQvf8Vb73HwzwGq40IdN.MvryioFAsvYCTPcXN SqJMpvcq1c_jrJlCXlfY0HJySyiDTenOF0Nhdd8AVTZjcVHSpTU.1Do.LHUAIRFVB3n.EnIokIPS tFaFmsjYLLCRyzBOW3EUjLDv8IY8gfKAgVRvMDwikUCZrjSDuKLB5iMNHSSDYW3JKPbRbV7SMIEO 5n.JropxKoZE7imvCoT37vP4emO7VE3.8ou96FhMO_.IwuNLsd8faaLpMdcmJzSohHG_LPZmvYSZ qqR9efJN3Q0X7GJzVC05hNCVFzz9ru7iJXh0SZR_4TuugtRmIaOpjDRsNCRtvDc8WZ8HxgJbhdUh JGIqd_hfLV2SVKeNS.xohOsppZkH6_cvDfCUKv053L_sTVfuEEQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.bf2.yahoo.com with HTTP; Thu, 22 Oct 2020 19:02:23 +0000 Received: by smtp423.mail.ir2.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 0e412871e37247791582074f817dc333; Thu, 22 Oct 2020 19:02:19 +0000 (UTC) To: FreeBSD Questions From: Ottavio Caruso Subject: What are "who parameters"? (man 8 renice) Message-ID: Date: Thu, 22 Oct 2020 20:02:18 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.3.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit References: X-Mailer: WebService/1.1.16868 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo Apache-HttpAsyncClient/4.1.4 (Java/11.0.7) X-Rspamd-Queue-Id: 4CHGvP1jglz4NCt X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.84 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.13)[-0.128]; FORGED_SENDER(0.30)[ottavio2006-usenet2012@yahoo.com,pr0f3ss0r1492@yahoo.com]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FROM_NEQ_ENVFROM(0.00)[ottavio2006-usenet2012@yahoo.com,pr0f3ss0r1492@yahoo.com]; SUBJECT_HAS_QUESTION(0.00)[]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-0.99)[-0.995]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.012]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[74.6.134.41:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[74.6.134.41:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 19:02:26 -0000 Can manual pages be more arcane and esoteric than this? % man 8 renice https://man.bsd.lv/FreeBSD-12.0/renice "The following who parameters are interpreted as ..." "-g Force who parameters to be interpreted as process group ID's." "-u Force the who parameters to be interpreted as user names or user ID's" "who" is underlined. Is it an acronym? I've seen this mentioned only in this man page on FreeBSD and NetBSD. The OpenBSD manual page seems to to be saner: https://man.bsd.lv/renice -- Ottavio Caruso From owner-freebsd-questions@freebsd.org Thu Oct 22 20:48:55 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4E9A42B182 for ; Thu, 22 Oct 2020 20:48:55 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: from mail-yb1-xb29.google.com (mail-yb1-xb29.google.com [IPv6:2607:f8b0:4864:20::b29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHKGG70nlz4VZ6 for ; Thu, 22 Oct 2020 20:48:54 +0000 (UTC) (envelope-from fernando.apesteguia@gmail.com) Received: by mail-yb1-xb29.google.com with SMTP id l15so2788584ybp.2 for ; Thu, 22 Oct 2020 13:48:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=l174EzNjpR/uVB+BsDDVGEsmG/YMZ25/NMB9M/lDSi8=; b=d6O+f2m0oy2RMqe0/b6nQXglhPPRrOV5R0otvQoPRMX1FVMXkSggFkV0soNohxCGeq dxGngaRmARFkZh5OIjRqw5D0p4e/rLWb4acFgaN5NOYZHLPQ/fv10grjZ1cr4BqXwRXi KhUZAJjqvNmXn1+O0nN6QvzSt6aFvJM0pngSmtgRZ60M15gjZ9nfFA7PVVdvzaCS1rkY j4bbbjDLQOlBsam9JTpvL/lpP4viyoNRL54NegAGP2lsjLq9WG+pLUkh9VYMR/f7f3s+ 6oaKDudu9onErrLQgzL9qZLVNJFpcawP4C6qjMiObZWls08TlNlBs+JEfMTqgGAN8FVX 3s3w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=l174EzNjpR/uVB+BsDDVGEsmG/YMZ25/NMB9M/lDSi8=; b=DuR/ZRx7FLZE8BZpuoNp1dbtCOv1My4Iv5IW3kz8LyKhCUD4Nd/GEgDRFm7txR8E+L P9HJZyqVvrc7qBYBe9GxSJb8BE2DaUBd1s8daBQe+BNTV4Yg+vD6eNAgUHzApbm126Yh EnapLy4Fl/b64BcygVTjgwnthiKTeeVldF3shMSEBkxd251y04CDsMa6CxW1IoHqKP6X qsjdIhrdM2Q+sfXs0g7OPjzKbB8FB2MncmcGymz2gNjlrDKCuK9T0A99sqIEdcQ7yGP2 6uffkrhFiFLpb6LNUJWzcS9jP6Bi1nyteuNHVcjz60FKKsqgOfggqC/kYIzyKFV5l/uP hi2w== X-Gm-Message-State: AOAM532lnN21qik3O9Pk7gR0c+XokS6kJxc4lMj3glM383H7zb+Ngwtv 746fkqr8lDdUSgH1Uk0pEde3RvE30IadsELHuus= X-Google-Smtp-Source: ABdhPJz8kR78zIxP9bGddTZilxexop0SCzAYvQJty9rBB5SqRr0ZJ5UTNHFND1gcciecjpkUp4M0mhwLuwrnth9/XlI= X-Received: by 2002:a25:ea03:: with SMTP id p3mr5361369ybd.377.1603399733970; Thu, 22 Oct 2020 13:48:53 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?Q?Fernando_Apestegu=C3=ADa?= Date: Thu, 22 Oct 2020 23:47:04 +0200 Message-ID: Subject: Re: What are "who parameters"? (man 8 renice) To: Ottavio Caruso Cc: FreeBSD Questions X-Rspamd-Queue-Id: 4CHKGG70nlz4VZ6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=d6O+f2m0; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of fernandoapesteguia@gmail.com designates 2607:f8b0:4864:20::b29 as permitted sender) smtp.mailfrom=fernandoapesteguia@gmail.com X-Spamd-Result: default: False [-3.51 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.57)[-0.572]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.94)[-0.942]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.993]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b29:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2020 20:48:56 -0000 On Thu, Oct 22, 2020 at 9:02 PM Ottavio Caruso via freebsd-questions < freebsd-questions@freebsd.org> wrote: > Can manual pages be more arcane and esoteric than this? > > % man 8 renice > > https://man.bsd.lv/FreeBSD-12.0/renice > > "The following who parameters are interpreted as ..." > > "-g > Force who parameters to be interpreted as process group ID's." > > "-u > Force the who parameters to be interpreted as user names or user ID's" > > "who" is underlined. Is it an acronym? I've seen this mentioned only in > this man page on FreeBSD and NetBSD. > I would say it has the same interpretation as in chmod(1). > > The OpenBSD manual page seems to to be saner: > https://man.bsd.lv/renice > > -- > Ottavio Caruso > _______________________________________________ > freebsd-questions@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to " > freebsd-questions-unsubscribe@freebsd.org" > From owner-freebsd-questions@freebsd.org Fri Oct 23 06:47:38 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8205143EBEA for ; Fri, 23 Oct 2020 06:47:38 +0000 (UTC) (envelope-from erwan@rail.eu.org) Received: from tgv.rail.eu.org (tgv.rail.eu.org [62.210.247.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHZY503lkz3Vgk for ; Fri, 23 Oct 2020 06:47:36 +0000 (UTC) (envelope-from erwan@rail.eu.org) Received: from [IPv6:2a01:e0a:2b7:70e1:e412:2a95:4c04:43d3] (unknown [IPv6:2a01:e0a:2b7:70e1:e412:2a95:4c04:43d3]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: erwan) by tgv.rail.eu.org (Postfix) with ESMTPSA id C18784262 for ; Fri, 23 Oct 2020 08:47:28 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=rail.eu.org; s=mail; t=1603435648; bh=ANIEKMwpyoXhvmpEqj/vXn4N+w1q36/c1LYscugAA/o=; h=Subject:To:References:From:Date:In-Reply-To:From; b=rWc2/SZ9UoSZXtewQ5uht3VP56Ytb816RIezUSKoB5+CzwTNAsrJdQrqi0GZ2/9jy XkSSjo5W2vZOe36MDSUlsDi9JbE4AZby4LK36gFDvkimfSliDpMc/d4yMvg29NbM7b 8KWTy9KlkOLFPXAVFpbCNSm+dG5T3IsP2DAcQfTg= Subject: Re: What are "who parameters"? (man 8 renice) To: freebsd-questions@freebsd.org References: From: Erwan David Message-ID: <6640d595-78bd-130b-cb4e-646f830a21b7@rail.eu.org> Date: Fri, 23 Oct 2020 08:47:26 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: fr Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CHZY503lkz3Vgk X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=rail.eu.org header.s=mail header.b=rWc2/SZ9; dmarc=pass (policy=none) header.from=rail.eu.org; spf=pass (mx1.freebsd.org: domain of erwan@rail.eu.org designates 62.210.247.50 as permitted sender) smtp.mailfrom=erwan@rail.eu.org X-Spamd-Result: default: False [-3.24 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[rail.eu.org:s=mail]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.999]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[rail.eu.org:+]; DMARC_POLICY_ALLOW(-0.50)[rail.eu.org,none]; NEURAL_HAM_SHORT(-0.25)[-0.247]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12876, ipnet:62.210.0.0/16, country:FR]; RCVD_COUNT_TWO(0.00)[2]; SUBJECT_HAS_QUESTION(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Oct 2020 06:47:38 -0000 Le 22/10/2020 à 21:02, Ottavio Caruso via freebsd-questions a écrit : > Can manual pages be more arcane and esoteric than this? > > % man 8 renice > > https://man.bsd.lv/FreeBSD-12.0/renice > > "The following who parameters are interpreted as ..." > > "-g >     Force who parameters to be interpreted as process group ID's." > > "-u >     Force the who parameters to be interpreted as user names or user ID's" > > "who" is underlined. Is it an acronym? I've seen this mentioned only in > this man page on FreeBSD and NetBSD. > > The OpenBSD manual page seems to to be saner: > https://man.bsd.lv/renice > who is defined in the first paragraph... From owner-freebsd-questions@freebsd.org Fri Oct 23 07:59:22 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 00792440039 for ; Fri, 23 Oct 2020 07:59:22 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (net-2-44-121-52.cust.vodafonedsl.it [2.44.121.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHc7r64Kqz3YVV for ; Fri, 23 Oct 2020 07:59:20 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.15.2) with ESMTPSA id 09N7xA2j087801 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Fri, 23 Oct 2020 09:59:11 +0200 (CEST) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu From: Andrea Venturoli Subject: pkg upgrade and dependency To: freebsd-questions@freebsd.org Message-ID: Date: Fri, 23 Oct 2020 09:59:10 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CHc7r64Kqz3YVV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 2.44.121.52 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.03 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:2.44.121.52]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.93)[-0.929]; TO_DN_NONE(0.00)[]; NEURAL_HAM_SHORT(-0.31)[-0.308]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30722, ipnet:2.44.0.0/16, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Oct 2020 07:59:22 -0000 Hello. In `man pkg-upgrade`, I read that "pkg upgrade tries to upgrade dependencies of packages matched". However, I have tried to upgrade a single package and only some of its direct run dependencies were upgraded; others were left untouched. How does this work? How is pkg discriminating what to update and what not? bye & Thanks av. From owner-freebsd-questions@freebsd.org Fri Oct 23 08:50:26 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F1B59440EB7 for ; Fri, 23 Oct 2020 08:50:26 +0000 (UTC) (envelope-from newton.ja.terry@gmail.com) Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHdGn5xFxz3bx6 for ; Fri, 23 Oct 2020 08:50:25 +0000 (UTC) (envelope-from newton.ja.terry@gmail.com) Received: by mail-ej1-x62e.google.com with SMTP id k3so1275452ejj.10 for ; Fri, 23 Oct 2020 01:50:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=1J3BWy2aG1RVo0Zy0euvkYNXQ3c3PJDohnBROXy7CpI=; b=jIQREl/8GFHhtnw1mbnlnuyV6l3IS+zMMhyYqYJGQd2d+FiuV8MEd0yrQmZfiJs+J6 nMVtICZzFeaL5j/bezXdmm7Wo0G7UixI36wRwO5H5yDviX1YPzZ11A+UP+k4NDIgCoil G7psOAjkVlvptf5bJRDMGT+83fggvYYowvHE2wO3IO6ZzNj5HveSOyknFU+flb9PWzBu hLva8XegS8Ie857xs5JK8+uQtFX1GyoLRwQsizK1FwLnUxztg0tgYJWrfNzzJQoMAVoL xT4WMmY2tc4RzN/4LY1d9HAV02cMaYgGExVlYnElj4Ih1EtwM3QDfHO46dWDEwTYV+Ar V7dA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-language:content-transfer-encoding; bh=1J3BWy2aG1RVo0Zy0euvkYNXQ3c3PJDohnBROXy7CpI=; b=Z/rLjLBOv3Mr0c+xWdprLmObzm6RnieMl4V3DckZrVAenqAo9rUxjNol3MzpvpJXSC DJrdJ0qGQPt7s4cpK/cbDcVjc9tV6gzwucBnZpBSXKRNmYY+htS9a9wDA4FG4Y2VW2tU 4su++d+6hW3cP9IHE8pPUmtrc98lPkQ9UUotYtP51MmxJTTw8KLloeTpIi1BfmbbZENR //Jw60O/F03HznJkOELb+HEOn9qqood8+kQIk0yK+WlnLUDBV5c77xuh9/iovk6meoT/ GqsdMhPY1wVJk5ys/wKxy0sUr5KGXaAoQ9NtM3XRV+8DHjQl1o/LnSprMeQiLcTCBKiV 2A5g== X-Gm-Message-State: AOAM5311J4KZ2vNpifVFrqwhCOwGHL16PT+n0pP1fxgRC14TybYhiyBr VZ4bJxTOsnaA7Vc0C7qDOaI4gnDiWks= X-Google-Smtp-Source: ABdhPJxdRYdxxMFVw8FSX6VCJgo30Rg7uMQRdlWZGYgtyH6BDBoEc43yAZyyTiTXwCjEdTQM3LKxxQ== X-Received: by 2002:a17:906:3407:: with SMTP id c7mr914158ejb.547.1603443023055; Fri, 23 Oct 2020 01:50:23 -0700 (PDT) Received: from HSPBM.local ([176.220.228.129]) by smtp.gmail.com with ESMTPSA id p4sm419153eji.105.2020.10.23.01.50.21 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 23 Oct 2020 01:50:22 -0700 (PDT) To: freebsd-questions@freebsd.org From: "N.J.Terry" Subject: Re: How to get to base.txz in the install image file Message-ID: <2d2c08f5-7acc-1c99-b4bd-178d8f9dde16@gmail.com> Date: Fri, 23 Oct 2020 11:50:25 +0300 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:78.0) Gecko/20100101 Thunderbird/78.3.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CHdGn5xFxz3bx6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=jIQREl/8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of newtonjaterry@gmail.com designates 2a00:1450:4864:20::62e as permitted sender) smtp.mailfrom=newtonjaterry@gmail.com X-Spamd-Result: default: False [-2.83 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.84)[-0.842]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[176.220.228.129:received]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.988]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.004]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62e:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Oct 2020 08:50:27 -0000 On 22.10.20 15:23, Ernie Luzar wrote: >I want to target the base.txz file in the release.img install file. >After downloading the release.img file how do I open it and point to >the base.txz file? Is there a way? You could create a memory disk with mdconfig(8) and mount it, e.g.: mdconfig -u md1 release.img mount /dev/md1s2a /mnt Path to file: /mnt/usr/freebsd-dist/base.txz After done with the file: umount /mnt mdconfig -du md1 From owner-freebsd-questions@freebsd.org Fri Oct 23 09:29:02 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 115FA44164A for ; Fri, 23 Oct 2020 09:29:02 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (net-2-44-121-52.cust.vodafonedsl.it [2.44.121.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CHf7J5pbbz3dHS for ; Fri, 23 Oct 2020 09:28:59 +0000 (UTC) (envelope-from ml@netfence.it) Received: from alamar.ventu (alamar.local.netfence.it [10.1.2.18]) (authenticated bits=0) by soth.netfence.it (8.16.1/8.15.2) with ESMTPSA id 09N9SuEA058085 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Fri, 23 Oct 2020 11:28:56 +0200 (CEST) (envelope-from ml@netfence.it) X-Authentication-Warning: soth.netfence.it: Host alamar.local.netfence.it [10.1.2.18] claimed to be alamar.ventu Subject: Re: pkg upgrade and dependency To: Mike Clarke , freebsd-questions@freebsd.org References: <1607868.MsCH1bHPGx@curlew> From: Andrea Venturoli Message-ID: <512fee04-8da3-6070-a7b0-1fa584fd9f9b@netfence.it> Date: Fri, 23 Oct 2020 11:28:56 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <1607868.MsCH1bHPGx@curlew> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CHf7J5pbbz3dHS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=netfence.it; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 2.44.121.52 as permitted sender) smtp.mailfrom=ml@netfence.it X-Spamd-Result: default: False [-3.99 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:2.44.121.52]; NEURAL_HAM_LONG(-1.01)[-1.010]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.22)[-1.223]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; NEURAL_HAM_MEDIUM(-0.95)[-0.954]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:30722, ipnet:2.44.0.0/16, country:IT]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Oct 2020 09:29:02 -0000 On 10/23/20 10:19 AM, Mike Clarke wrote: > It will only upgrade those dependencies for which there's a more recent > version. Well, that should be obvious. However that seems to be a required condition, not a sufficient condition. There must be some sort of additional checks, as some dependencies which were upgradable were left untouched. bye & Thanks av. From owner-freebsd-questions@freebsd.org Sat Oct 24 03:59:55 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9819343A499 for ; Sat, 24 Oct 2020 03:59:55 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [174.136.98.114]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJ6n56Y14z40qV for ; Sat, 24 Oct 2020 03:59:53 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from [192.168.1.160] (cpe-24-24-163-126.socal.res.rr.com [24.24.163.126]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 154ccab2 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Sat, 24 Oct 2020 03:59:46 +0000 (UTC) To: questions list From: Pete Wright Subject: Problems creating bootable image with poudriere/12.2-RC3 Message-ID: <225d9d5a-f4de-d5ac-b670-546e354951e5@nomadlogic.org> Date: Fri, 23 Oct 2020 20:59:40 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.3.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4CJ6n56Y14z40qV X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 174.136.98.114 as permitted sender) smtp.mailfrom=pete@nomadlogic.org X-Spamd-Result: default: False [-2.34 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.92)[-0.919]; DMARC_NA(0.00)[nomadlogic.org]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.37)[-0.374]; NEURAL_HAM_MEDIUM(-0.75)[-0.750]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:25795, ipnet:174.136.96.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 03:59:55 -0000 Hello, I am trying to build a bootable raw disk image to boot in QEMU.  I had done this with 12.1-RELEASE, but for some reason when I attempt this with 12.2-RC3 qemu is not able to find a bootable disk.  I believe this is probably something I'm missing on my end and was hoping someone could see what error I'm making. I build the jail like so: poudriere jail -c -j 12_2 -a amd64 -z 12_2  -b -m src=/usr/home/pete/git/freebsd -K GENERIC Then I create the image like so: poudriere image -t rawdisk -j 12_2 -n bsd_12_2 -s 10g -h test.nomadlogic.org -o ~pete/wrk/freebsd/release/vmimages/ As I mentioned when i try to start qemu pointing to the rawdisk image it reports that it can't find a bootable device. Interestingly enough the disk images from 12.1 work, so perhaps I've got a bad jail build command? Thanks for any pointers here! -pete -- Pete Wright pete@nomadlogic.org @nomadlogicLA From owner-freebsd-questions@freebsd.org Sat Oct 24 09:51:39 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9FF324430EA for ; Sat, 24 Oct 2020 09:51:39 +0000 (UTC) (envelope-from thebigblueguard@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJGZy4cC8z4Kmx for ; Sat, 24 Oct 2020 09:51:38 +0000 (UTC) (envelope-from thebigblueguard@gmail.com) Received: by mail-pg1-x530.google.com with SMTP id t14so3123786pgg.1 for ; Sat, 24 Oct 2020 02:51:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=mK+/84G75XN6+OWoJfKtC5TqSA+i6i93DK76G2Qz4eQ=; b=vHMNCVAU5NJKm7LIvgLSVyJE6uwPProYk2ApDF+ZggVTM7DofDW2AAzY0hqngFSHvt 4nTVqdcM/mHlPwsFUj1f7UEuRUU9s5s3lnOR0zSbeH29EDZe+9PRl5YFRrudPUr8WyyE MzBl+rGXOffq95j1V13rwSmbqwl4xGBP5Dn4xFgi81RLdawyVuD+LboS+A41toXLkrBc t55TqJPlFZEw0HduLoi3tGR1vwB4f2vsDgqabbjFvQWBUNSXpAwYWKqjvezx7igp1RFB q5goD5zjBjjAAtaJTr4lZBrIo1MQK+kJERd1FEIvUBgPLGGwSqi8L69BlRO31Wy0EnKH 4r6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=mK+/84G75XN6+OWoJfKtC5TqSA+i6i93DK76G2Qz4eQ=; b=anzS5N01QoiKtEHSeL2HJ1nKPCZzPROALoYzoO8ghCSj6ZJ/NbaHAmqM/L+OR4AorZ kOmXUqrBZYeB5nYO1E+78h6jQneC6gI3oCTBCVMsVZRToU12g2fNQUMsw8QzAadUNtI/ XV58zyVWH9pemwwsz+WRVN8BUoHCt5f5ZVrAZ/6Skaz8K73yjVBT0PSfx9vrRg1S34XJ hLY0TnCMtIoJg2yQTZBxNGIM22eBr3u0NqUzePbpRepioCDQzpjwekGvHZRkxOEa2Ek2 dju7z5e76hAGv10DusA+XWizXaXnpm7wyS32zfiBL8v8JGNeW3XZrQLIyxgKb62S13rr fnww== X-Gm-Message-State: AOAM530V9ZFXHnC1nJ4cvgcLkAqZzwuH7Oq5Efa3USUVOdIXbjNFelvK aFUlNPCFVbp0f0OnJ+wFr+n86XtxX5awqQ/vPlpJrGTxpMM= X-Google-Smtp-Source: ABdhPJzuwylN1tZDronZ11Tp5sixrdWv0F49O0da8ia+AA/fONUPoOe5VQKj7BMslqxnU3Q7gTe1d8A5em39I6GWVLQ= X-Received: by 2002:a62:34c7:0:b029:15d:e9de:f618 with SMTP id b190-20020a6234c70000b029015de9def618mr3405348pfa.58.1603533096640; Sat, 24 Oct 2020 02:51:36 -0700 (PDT) MIME-Version: 1.0 From: TheBigBlue Guard Date: Sat, 24 Oct 2020 02:51:25 -0700 Message-ID: Subject: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? To: freebsd-questions@freebsd.org X-Rspamd-Queue-Id: 4CJGZy4cC8z4Kmx X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=vHMNCVAU; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of thebigblueguard@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=thebigblueguard@gmail.com X-Spamd-Result: default: False [-1.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.04)[-1.036]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.001]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::530:from]; NEURAL_SPAM_SHORT(0.23)[0.234]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 09:51:39 -0000 Yes ...everyone...What is the "better /best and least expensive " method(s) to mult-boot different OSes natively WITHOUT virtual boxes like VirtualPC or DOSBox etc. I was seriously thinking about mult-booting 5-6 different operating systems including freeBSD..... Thanks for reading this Sincerely, BigBlue From owner-freebsd-questions@freebsd.org Sat Oct 24 10:10:23 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BCEA0443E3A for ; Sat, 24 Oct 2020 10:10:23 +0000 (UTC) (envelope-from 4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJH0Z6Mm1z4LhL for ; Sat, 24 Oct 2020 10:10:22 +0000 (UTC) (envelope-from 4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com) DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1603534219; x=1606126219; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:to:from:date:x-thread-info; bh=FK4Wu99+c8x5tkskJZ3vXrOinWApt7z9FU0Pa398wgU=; b=Kuo0aAGfQkN0UuszPeJtB63w4B9W6EG13Lw9mBSlFz7qsVlcC/9ktuHG4JsbwpoT1Q7eEn7dExEtbEO25bEpwgxaROGZXGqvgPDh99nfpfn9RYD90bqaGyIff8SKVxvATTsMMri3Hm6YA3lYyCO5w3iVCFOGimxQr63iiGkTIMU= X-Thread-Info: NDI1MC45Mi4xZDRjNTAwMDRkYTk1ZDAuZnJlZWJzZC1xdWVzdGlvbnM9ZnJlZWJzZC5vcmc= Received: from r2.us-east-1.aws.in.socketlabs.com (r2.us-east-1.aws.in.socketlabs.com [142.0.191.2]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sat, 24 Oct 2020 06:10:08 -0400 Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r2.us-east-1.aws.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sat, 24 Oct 2020 06:10:20 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.94 (FreeBSD)) (envelope-from ) id 1kWGV0-0002ju-Uq for freebsd-questions@freebsd.org; Sat, 24 Oct 2020 11:10:11 +0100 Date: Sat, 24 Oct 2020 11:10:10 +0100 From: Steve O'Hara-Smith To: freebsd-questions@freebsd.org Subject: Re: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? Message-Id: <20201024111010.5c867e8540a369b826d26703@sohara.org> In-Reply-To: References: X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) X-Clacks-Overhead: "GNU Terry Pratchett" Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CJH0Z6Mm1z4LhL X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=Kuo0aAGf; dmarc=none; spf=pass (mx1.freebsd.org: domain of 4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com X-Spamd-Result: default: False [-1.22 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[142.0.176.198:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[sohara.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.001]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.01)[-1.012]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; DKIM_TRACE(0.00)[email-od.com:+]; NEURAL_HAM_SHORT(-0.50)[-0.504]; RCVD_IN_DNSWL_NONE(0.00)[142.0.176.198:from]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d4c50004da95d0.6e3a10a0bd757c9cc9eebb1395d7251a@email-od.com]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 10:10:23 -0000 On Sat, 24 Oct 2020 02:51:25 -0700 TheBigBlue Guard wrote: > Yes ...everyone...What is the "better /best and least expensive " A bot swap drive bay is the most foolproof and reliable method that ensures no OS no matter how buggy or misguided can mess up another. -- Steve O'Hara-Smith From owner-freebsd-questions@freebsd.org Sat Oct 24 10:31:53 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 11B9D444724 for ; Sat, 24 Oct 2020 10:31:53 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJHTM3HVTz4N1c for ; Sat, 24 Oct 2020 10:31:50 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r56.edvax.de ([94.222.10.141]) by mrelayeu.kundenserver.de (mreue009 [212.227.15.167]) with ESMTPA (Nemesis) id 1MY60L-1ktmLB0sVZ-00YPSM; Sat, 24 Oct 2020 12:31:48 +0200 Date: Sat, 24 Oct 2020 12:31:48 +0200 From: Polytropon To: TheBigBlue Guard Cc: freebsd-questions@freebsd.org Subject: Re: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? Message-Id: <20201024123148.4929fb9e.freebsd@edvax.de> In-Reply-To: References: Reply-To: Polytropon Organization: EDVAX X-Mailer: Sylpheed 3.1.1 (GTK+ 2.24.5; i386-portbld-freebsd8.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:wbOp66VozFa+k++5rd5Zv6qwJP8V1zYHf5+ENOzJWPsL3Bfh6rX qN1kexzDFUCiWoCrBHxyeFwUuq0jhHthWU5Q5erwJore87vieqsbi+CeFfHTP8oLzXfJ49A +BIPR81d0iAJTJ9lpHAclNDaInlhx0Cz52JXRPJMclLAAtu/9GRgd8xiGOJAJq1uLeDvnVT fe4imacY0JIcHSS18wG4Q== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:ypRqV9CgnXo=:U3CQrYMEd/UTAKCMgPSNIg wRbEDexW7UTiwnmA4Dz8q+CNuG3p1fNmYaAnT6CCG7cTPwVdKBH1kPzdbwRRFdEKmQb/6xq7Z NGwJGfuSUF5OOgInFeZl+45kVM0K/885Ml2JNfFQuiI2XO/pgy9sEHURVchoyci1lu6sZfmsT 53TJP6hYWQUTSnn57uAVKcN1/4iQNZBFusG0w02Q0GVli7e+f50jKfk+ScxQDGqyPMIJPmRqP ihh0kbxFEuwWVc9YEeatINo2BAoE/5wV/ATkzfrq7PAH1mS8/mhP7kM445kL0/AdsWZF/LQfv ZZnYNKn1hbxJWtG+NYucIzbc1jDAIBbQnHiH6G3azLI4OgtZ3UU/nI8PeBdcJqedW7PPNWMLf LSqtVDhdDf8cfxk84ULl90M69E+k4zfzY+gcpP9BanlFs2rLC6C4gXyOUuFPR X-Rspamd-Queue-Id: 4CJHTM3HVTz4N1c X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@edvax.de has no SPF policy when checking 212.227.126.130) smtp.mailfrom=freebsd@edvax.de X-Spamd-Result: default: False [3.32 / 15.00]; HAS_REPLYTO(0.00)[freebsd@edvax.de]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; HAS_ORG_HEADER(0.00)[]; NEURAL_HAM_SHORT(-0.19)[-0.195]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; RECEIVED_SPAMHAUS_PBL(0.00)[94.222.10.141:received]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-0.58)[-0.583]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[edvax.de]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.69)[0.694]; MID_CONTAINS_FROM(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[212.227.126.130:from]; R_SPF_NA(0.00)[no SPF record]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.126.130:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 10:31:53 -0000 On Sat, 24 Oct 2020 02:51:25 -0700, TheBigBlue Guard wrote: > Yes ...everyone...What is the "better /best and least expensive " method(s) > to mult-boot different OSes natively WITHOUT virtual boxes like VirtualPC > or DOSBox etc. I was seriously thinking about mult-booting 5-6 different > operating systems including freeBSD..... Depends. On sooo many things... ;-) Is your computer using BIOS or UEFI? Do you have MBR or GPT partitions in place? Shall the different systems be aware of each other? Is it intended for them to share resources? If you can answer with "yes", "yes", and "let's see", the following article is probably quite helpful for you: https://github.com/bourne-again/TripleBoot-UEFI For this to be valid, I simply assume that you have a sufficiently recent PC that no longer uses a BIOS, and you will prepare your disks using GPT. Those are a lot of assumtions, though. And as I said initially, there is no definite answer, because the question contains too many variables. Does not compute. :-) -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-questions@freebsd.org Sat Oct 24 12:28:10 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 257AC448091 for ; Sat, 24 Oct 2020 12:28:10 +0000 (UTC) (envelope-from chris@cretaforce.gr) Received: from relay1.cretaforce.gr (relay1.cretaforce.gr [195.201.253.145]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.cretaforce.gr", Issuer "RapidSSL RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJL3Y1N4Dz4VFy for ; Sat, 24 Oct 2020 12:28:09 +0000 (UTC) (envelope-from chris@cretaforce.gr) Received: from server1.cretaforce.gr (server1.cretaforce.gr [138.201.248.69]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.cretaforce.gr", Issuer "RapidSSL RSA CA 2018" (verified OK)) by smtp1.cretaforce.gr (Postfix) with ESMTPS id A29761FA06 for ; Sat, 24 Oct 2020 15:28:07 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cretaforce.gr; s=cretaforce; t=1603542487; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=WlKeSC23dGvU9I6VNQ7eut8WiRo6CSLAxOohyeX38uY=; b=v6DUnCgoDudlW/D8RgJ5HwjgLT4SDiNLgjfADvta/rs1e9semmmKdktBB/dX01iZgq6c5V oToDTxmScQ/uOCdBG2uJb0R7wSIQSnrz/BQi+tJzmopuYOg8svcrPcZ7xXrcjU0unOOMig VL1e7j+FnL71jAhi0RIUoPoF83R6Bjk= Received: from macbook-air.fritz.box (athedsl-172484.home.otenet.gr [85.75.217.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: chris@cretaforce.gr) by server1.cretaforce.gr (Postfix) with ESMTPSA id 4808327330 for ; Sat, 24 Oct 2020 15:28:07 +0300 (EEST) From: Christos Chatzaras Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: PHP-FPM processes hang in UFS-state Message-Id: <675E2CFF-C45D-48C2-8E55-4E9876D5098A@cretaforce.gr> Date: Sat, 24 Oct 2020 15:28:07 +0300 To: freebsd-questions@freebsd.org X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4CJL3Y1N4Dz4VFy X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cretaforce.gr header.s=cretaforce header.b=v6DUnCgo; dmarc=none; spf=pass (mx1.freebsd.org: domain of chris@cretaforce.gr designates 195.201.253.145 as permitted sender) smtp.mailfrom=chris@cretaforce.gr X-Spamd-Result: default: False [-4.04 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.201.253.145:c]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[cretaforce.gr:+]; NEURAL_HAM_SHORT(-0.92)[-0.925]; RECEIVED_SPAMHAUS_PBL(0.00)[85.75.217.98:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:195.201.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[195.201.253.145:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.05)[-1.047]; R_DKIM_ALLOW(-0.20)[cretaforce.gr:s=cretaforce]; FREEFALL_USER(0.00)[chris]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.971]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; DMARC_NA(0.00)[cretaforce.gr]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[cretaforce.gr:dkim]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 12:28:10 -0000 This issue happened in 3 different servers the last months. Some PHP-FPM processes hang in UFS-state. The websites that cause the hang are all Prestashop and it's related to = their var/cache files (I believe it happens when they clear the cache = and the files are regenerated). This is a php-fpm process that hang: procstat -kk 73548 PID TID COMM TDNAME KSTACK 73548 100630 php-fpm - mi_switch+0xe2 = sleepq_wait+0x2c sleeplk+0x185 lockmgr_xlock_hard+0x1f5 = __lockmgr_args+0x2bf ffs_lock+0xa5 VOP_LOCK1_APV+0x7c _vn_lock+0x44 = vget+0x4a vfs_hash_get+0xb0 ffs_vgetf+0x3f softdep_sync_buf+0xbee = ffs_syncvnode+0x26f ffs_truncate+0x71b ufs_direnter+0x5f8 = ufs_makeinode+0x5fb ufs_create+0x34 VOP_CREATE_APV+0x76=20 procstat -kk -a : https://www.coderz.gr/ufs/procstat.txt mount | grep home : https://www.coderz.gr/ufs/mount.txt dumpfs /dev/mirror/gm0p7 : https://www.coderz.gr/ufs/dumpfs.txt I have to force reboot the server as /home is not possible to clean = unmount. Then I run fsck which fixes some issues because of the unclean = reboot. Then I run fsck again that shows no errors. Then I mount /home = and first rename the cache folders and finally delete var/cache and = allow it to regenerate prestashop files. But the same issue happens = again after few days. Any idea how to troubleshoot it?= From owner-freebsd-questions@freebsd.org Sat Oct 24 17:40:23 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D493F44F960 for ; Sat, 24 Oct 2020 17:40:23 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [184.105.128.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.holgerdanske.com", Issuer "www.holgerdanske.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJSzp1pWFz3btY for ; Sat, 24 Oct 2020 17:40:21 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from 99.100.19.101 (99-100-19-101.lightspeed.frokca.sbcglobal.net [99.100.19.101]) by holgerdanske.com with ESMTPSA (TLS_AES_128_GCM_SHA256:TLSv1.3:Kx=any:Au=any:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Sat, 24 Oct 2020 10:40:11 -0700 Subject: Re: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? To: freebsd-questions@freebsd.org References: <20201024111010.5c867e8540a369b826d26703@sohara.org> From: David Christensen Message-ID: <8bfbda9f-79b9-5e45-7c00-de32da3f14ed@holgerdanske.com> Date: Sat, 24 Oct 2020 10:40:10 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <20201024111010.5c867e8540a369b826d26703@sohara.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CJSzp1pWFz3btY X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of dpchrist@holgerdanske.com has no SPF policy when checking 184.105.128.27) smtp.mailfrom=dpchrist@holgerdanske.com X-Spamd-Result: default: False [3.57 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.51)[0.506]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.33)[0.333]; ARC_NA(0.00)[]; NEURAL_SPAM_LONG(0.83)[0.830]; DMARC_NA(0.00)[holgerdanske.com]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:184.104.0.0/15, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MAILMAN_DEST(0.00)[freebsd-questions]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 17:40:23 -0000 On 2020-10-24 03:10, Steve O'Hara-Smith wrote: > On Sat, 24 Oct 2020 02:51:25 -0700 > TheBigBlue Guard wrote: > >> Yes ...everyone...What is the "better /best and least expensive " > > A [boot] swap drive bay is the most foolproof and reliable method that > ensures no OS no matter how buggy or misguided can mess up another. Boot drive swap bay -- minimum effort, maximum reliability, and maximum expense. This is what I do. Multi-boot -- maximum effort, minimum reliability, and minimum expense. David From owner-freebsd-questions@freebsd.org Sat Oct 24 19:32:24 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C29044527FD for ; Sat, 24 Oct 2020 19:32:24 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.133]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJWT31tCBz416P for ; Sat, 24 Oct 2020 19:32:22 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r56.edvax.de ([94.222.10.141]) by mrelayeu.kundenserver.de (mreue011 [212.227.15.167]) with ESMTPA (Nemesis) id 1M7am5-1kTPWg2Gar-007yk9; Sat, 24 Oct 2020 21:32:11 +0200 Date: Sat, 24 Oct 2020 21:32:11 +0200 From: Polytropon To: David Christensen Cc: freebsd-questions@freebsd.org Subject: Re: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? Message-Id: <20201024213211.065fdb26.freebsd@edvax.de> In-Reply-To: <8bfbda9f-79b9-5e45-7c00-de32da3f14ed@holgerdanske.com> References: <20201024111010.5c867e8540a369b826d26703@sohara.org> <8bfbda9f-79b9-5e45-7c00-de32da3f14ed@holgerdanske.com> Reply-To: Polytropon Organization: EDVAX X-Mailer: Sylpheed 3.1.1 (GTK+ 2.24.5; i386-portbld-freebsd8.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Provags-ID: V03:K1:+gGEoIj8EZSGyt2uJZ8ZHty195tv2VgMbVjl4Zn+xQbduH1NZpQ Xr0zl6sKWdrk4va/A/5BABb8I59oxX9pBnY3suDGtA7zJMo+nBrcRQ1SdoW/tslRNX/Sstm PNVrV5Jg+6Hu2eBsGgfSIGRJwS4sXGKFwZnrfh5ntWNXwPWuFozBwOUgotywS0C2ddiuRha cQEJ0OmprxOy2frvkOD1A== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:+EVQOlWdZMw=:Z9B5aoydJPcIIGCIpO+xJ1 xpYMe2YcjL1PXuBzOM7lOZsu9Jto3Q/XDTl8kUKZnJhev2Ni02EBCj+kNzzzm/QKgNZEv1MLY 2mJxuMR/el2EmuFt6sFtddszS/+1WsC2ODhHiYpeXv3zfMbfSPdKGf0i8Vg0CeKTg9d5FqA+/ HKHoKOtefqLNIhknBd+fa86jS/TPhUaY+7qI4vZ3sntoXao4GBL47EA4fpnM4Q6XWNRXw7sFF HyXZXYz2BsJK1DTu4hXKdpWBydCqATqSqCU4Wgx0PflVbHPm1TJbruzSrhaZDpTqwGZIPbaDB EtfZXTqR4+eEFagUc2Rd+JPK31gBkTNmAG8hFM9Lp8K5vJMXB8QN/EJg3aYibFvEcLZsntZIt YlO0AKU+8u4/jCagfZQaLuG2gOd0IKHsFI5ual3QDFYh19DKomfzoPb0B4hQr X-Rspamd-Queue-Id: 4CJWT31tCBz416P X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@edvax.de has no SPF policy when checking 212.227.126.133) smtp.mailfrom=freebsd@edvax.de X-Spamd-Result: default: False [3.37 / 15.00]; HAS_REPLYTO(0.00)[freebsd@edvax.de]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; HAS_ORG_HEADER(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RECEIVED_SPAMHAUS_PBL(0.00)[94.222.10.141:received]; RCVD_TLS_LAST(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-0.76)[-0.761]; NEURAL_SPAM_SHORT(0.38)[0.376]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[edvax.de]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.36)[0.358]; MID_CONTAINS_FROM(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[212.227.126.133:from]; R_SPF_NA(0.00)[no SPF record]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.126.133:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 19:32:24 -0000 On Sat, 24 Oct 2020 10:40:10 -0700, David Christensen wrote: > On 2020-10-24 03:10, Steve O'Hara-Smith wrote: > > On Sat, 24 Oct 2020 02:51:25 -0700 > > TheBigBlue Guard wrote: > > > >> Yes ...everyone...What is the "better /best and least expensive " > > > > A [boot] swap drive bay is the most foolproof and reliable method that > > ensures no OS no matter how buggy or misguided can mess up another. > > > Boot drive swap bay -- minimum effort, maximum reliability, and maximum > expense. This is what I do. > > > Multi-boot -- maximum effort, minimum reliability, and minimum expense. Add safety to the list - a disk that is not in the machine cannot be messed up by a stupid installer program. :-) -- Polytropon Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-questions@freebsd.org Sat Oct 24 19:41:43 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 82AB845287F for ; Sat, 24 Oct 2020 19:41:43 +0000 (UTC) (envelope-from 4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com) Received: from s1-b0c6.socketlabs.email-od.com (s1-b0c6.socketlabs.email-od.com [142.0.176.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJWgp4zFmz41ks for ; Sat, 24 Oct 2020 19:41:42 +0000 (UTC) (envelope-from 4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com) DKIM-Signature: v=1; a=rsa-sha256; d=email-od.com;i=@email-od.com;s=dkim; c=relaxed/relaxed; q=dns/txt; t=1603568498; x=1606160498; h=content-transfer-encoding:content-type:mime-version:references:in-reply-to:message-id:subject:cc:to:from:date:x-thread-info; bh=1jZWb7DxFknBv7uS41nciPTzlTAgPlwX7B/7M1IZh6Y=; b=kgvcnVCZkBRYkIHDv8HLNcq4gwyUmxfscFiOyUwIPwE4zteNZa/EtPEaJnwlJfvTWLeQnCWZbVmFV6y6LBUgpKwW5VWBiVnq/3Bj6hxcTnNCKY6Rwj+YqGNug3k4+zQNfiAq3hDHb1J2xbisnx+afilYWuyr80jt1nYAbFplEdU= X-Thread-Info: NDI1MC45Mi4xZDRjNTAwMDRlYjdlMTEuZnJlZWJzZC1xdWVzdGlvbnM9ZnJlZWJzZC5vcmc= Received: from r2.us-east-2.aws.in.socketlabs.com (r2.us-east-2.aws.in.socketlabs.com [142.0.189.2]) by mxsg2.email-od.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sat, 24 Oct 2020 15:41:32 -0400 Received: from smtp.lan.sohara.org (EMTPY [185.202.17.215]) by r2.us-east-2.aws.in.socketlabs.com with ESMTP(version=Tls12 cipher=Aes256 bits=256); Sat, 24 Oct 2020 15:42:10 -0400 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.94 (FreeBSD)) (envelope-from ) id 1kWPPx-0005O9-Vp; Sat, 24 Oct 2020 20:41:34 +0100 Date: Sat, 24 Oct 2020 20:41:33 +0100 From: Steve O'Hara-Smith To: freebsd-questions@freebsd.org Cc: Polytropon Subject: Re: What is the "better / best " method to multi-boot different OSes natively WITHOUT VirtualBox(es) ? Message-Id: <20201024204133.5820dc79a75c02c3ff2c2da1@sohara.org> In-Reply-To: <20201024213211.065fdb26.freebsd@edvax.de> References: <20201024111010.5c867e8540a369b826d26703@sohara.org> <8bfbda9f-79b9-5e45-7c00-de32da3f14ed@holgerdanske.com> <20201024213211.065fdb26.freebsd@edvax.de> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) X-Clacks-Overhead: "GNU Terry Pratchett" Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CJWgp4zFmz41ks X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=email-od.com header.s=dkim header.b=kgvcnVCZ; dmarc=none; spf=pass (mx1.freebsd.org: domain of 4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com designates 142.0.176.198 as permitted sender) smtp.mailfrom=4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com X-Spamd-Result: default: False [-1.22 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[email-od.com:s=dkim]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:142.0.176.0/20]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sohara.org]; NEURAL_HAM_LONG(-0.98)[-0.983]; RWL_MAILSPIKE_GOOD(0.00)[142.0.176.198:from]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[email-od.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[142.0.176.198:from]; NEURAL_HAM_SHORT(-0.49)[-0.495]; NEURAL_HAM_MEDIUM(-1.04)[-1.043]; FORGED_SENDER(0.30)[steve@sohara.org,4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:7381, ipnet:142.0.176.0/22, country:US]; FROM_NEQ_ENVFROM(0.00)[steve@sohara.org,4250.82.1d4c50004eb7e11.e708dbcf65fdaa635c9f457ce8fd14f1@email-od.com]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2020 19:41:43 -0000 On Sat, 24 Oct 2020 21:32:11 +0200 Polytropon wrote: > On Sat, 24 Oct 2020 10:40:10 -0700, David Christensen wrote: > > On 2020-10-24 03:10, Steve O'Hara-Smith wrote: > > > On Sat, 24 Oct 2020 02:51:25 -0700 > > > TheBigBlue Guard wrote: > > > > > >> Yes ...everyone...What is the "better /best and least expensive " > > > > > > A [boot] swap drive bay is the most foolproof and reliable > > > method that ensures no OS no matter how buggy or misguided can mess > > > up another. > > > > > > Boot drive swap bay -- minimum effort, maximum reliability, and maximum > > expense. This is what I do. > > > > > > Multi-boot -- maximum effort, minimum reliability, and minimum expense. > > Add safety to the list - a disk that is not in the machine > cannot be messed up by a stupid installer program. :-) This is (an example of) what makes it the least expensive approach, anything else is bound to wind up costing you hours at some point. -- Steve O'Hara-Smith