From owner-freebsd-stable@freebsd.org Sat Jun 13 02:35:55 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 05EBE34D6F3 for ; Sat, 13 Jun 2020 02:35:55 +0000 (UTC) (envelope-from dewayne@heuristicsystems.com.au) Received: from hermes.heuristicsystems.com.au (hermes.heuristicsystems.com.au [203.41.22.115]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2560 bits) client-digest SHA256) (Client CN "hermes.heuristicsystems.com.au", Issuer "Heuristic Systems Type 4 Host CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49kMCX0GRmz4PJ1 for ; Sat, 13 Jun 2020 02:35:51 +0000 (UTC) (envelope-from dewayne@heuristicsystems.com.au) Received: from [10.0.5.3] (noddy.hs [10.0.5.3]) (authenticated bits=0) by hermes.heuristicsystems.com.au (8.15.2/8.15.2) with ESMTPSA id 05D2ZHT5095059 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT) for ; Sat, 13 Jun 2020 12:35:18 +1000 (AEST) (envelope-from dewayne@heuristicsystems.com.au) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=heuristicsystems.com.au; s=hsa; t=1592015718; x=1592620519; bh=Fh1S+u6tmMlQue+DOAVyVtlBiPJ74SmvMompH7VEP/U=; h=Subject:To:From:Message-ID:Date; b=LZVt9RvNV6nPkMARzJa6qtL3JRbanBMu3vxriI0vUTeaQRxS8w4x9rVIcUyGlIlXt D3LpuZ5NuCTWdq0kERFypQIRBV/bqUTJ5X0JAno7ydvgnlA6zoY+N2lbB+2SbEwWyb cDA8GHqV6CtjRfKdsVVFaowpfKbZWQUxHSUWy5sHEvN0hl96Nu/K6 X-Authentication-Warning: b3.hs: Host noddy.hs [10.0.5.3] claimed to be [10.0.5.3] Subject: Re: Upgrading to 12.1S 362003 - a few issues To: freebsd-stable@freebsd.org References: <978b8cb5-de88-4264-25ec-e7ecaaf80c75@heuristicsystems.com.au> <20200613013450.GS48478@kib.kiev.ua> From: Dewayne Geraghty Autocrypt: addr=dewayne@heuristicsystems.com.au; prefer-encrypt=mutual; keydata= mQFNBFbOsVMBCgDfvi2PspSwoMEtFhF+aFLQKtzSA9f0dhDqthKHESdfbqxvKzhkBjvTJ5Na EgjKoKfoQTh5xuIv3HLhtDo5PeasPgQl9cPJeriqmqlS+UhY5BGYcMc1AO/TX0fsDaQz96ko at3RUW7sff/qPgVzSurk+DV5h866gPdn5Jdjohyl2F1rzRl6dnaAIyg49zlwZOnPHJGKye+B meqUCnPRglhkpNqXR3v1ulbWpfwhdNDvWT82qTG/qsFy/agjJvxwLuEBeoGc1dPWasO8Nztt 0dqf1Lpeg6SX2yJd76WVS4znt88OEbx/QL2PTJ/YtSepS68WaeKuARKPukkU+QXDep0gaLPl /TvU5xAZndNB3rYnpmoLb32pDHlrJbZUVyTMqc3J2EYM6aaizCpg4VEvVpVSqUT4D9MuREhu PeZ3SvEazQARAQABiQF3BB8BCAAhBQJWzrFTFwyAAWHe5yZt8RJL0vaU1MfDto5dBmeFAgcA AAoJEJVk7a1LmFrdy2QJ/AysDdFIMCRiaqEellprZQyEz5I/qZJEi6yRfXH813hhISFz6moh urZYLQ9SRdyMntT8W3Oc4pJc9fF9RSnY0SSQY/arZbrvsv6hKb1KtIK7P5mLS914J9buxEcJ SWeVuOuMA9aCNqg5uMu19pH5pXayORfbv+K7vFPiyllZ64ShUWZJL69vAc/TsbvMrGtG1M4P qyWCOKEiUT93zhVGQoA0aUYjMAZoyvozZCuieo4O8hkPgMz9lka+3bqQBSOB+qO4Iz+CZs0k Lw7Soga6bRqLK86DH99WjTA6Oj1r8Won+j4V9fnTDCVJoSyqdVHLySDv/lHaNu4Ia4AO4i2d shmLw03gOUvoWLJx5X01A5Zio4FvecnpZqQ0Wz5Ph9MiK3lwarfjonTOLeNGd5BpdnHu5VRC fJml7uAYeyKsD8C4tEBEZXdheW5lIEdlcmFnaHR5IDxkZXdheW5lLmdlcmFnaHR5QGNvbnNj aXVtaW50ZXJuYXRpb25hbC5jb20uYXU+iQGXBBMBCABBAhshCwsKDQkIDAcLAwIECBUKCQgL AwIBBRYDAgEAAh4BAheAFiEEC8bIxjMx+sDl4ZCClWTtrUuYWt0FAl5UUOgACgkQlWTtrUuY Wt3xZAn/W/mq5nDhLIfqxVM9GbU8rGzNsGLfnt5NCVcWlBKhgxOOw9EWkcRTMymwX9OMqwxI +te6Gvy7rG53T2xprtsQyqESZmjWcUSEPsQ9hjw4VZCL15ftBeZMYyO2T1e41UImXAlftleT 2kXCktgyAfwfCzHhFiZM8k9QMFQV1x+JukJ9xPFBgICRLsLsVNVw/R1L7KqARuws4HqXxY1J SCpO+FB4b6tWSIRKbzlb6tctdKppKbG/adVYuoK61ngvmsAzy/9OLhF8u1MNCgyFd2woOErh /zyuap8KvJZMlwAIqpjsoHyXsa0cq8A/uNQSmodwBpRsEGXCmZIZq2FJw6N+38to8C8m97q0 YWrY63VsoA6hA4A4/ywzE3EiwGvqJQBMRv2ET3TIdTyLoEIwXq2bDPU7XTZGh5UZEsKFMHH5 228= Message-ID: <355bf1bc-82cf-a558-16df-1c7c2503c7a8@heuristicsystems.com.au> Date: Sat, 13 Jun 2020 12:34:46 +1000 User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <20200613013450.GS48478@kib.kiev.ua> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49kMCX0GRmz4PJ1 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=heuristicsystems.com.au header.s=hsa header.b=LZVt9RvN; dmarc=none; spf=pass (mx1.freebsd.org: domain of dewayne@heuristicsystems.com.au designates 203.41.22.115 as permitted sender) smtp.mailfrom=dewayne@heuristicsystems.com.au X-Spamd-Result: default: False [-5.33 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[heuristicsystems.com.au:s=hsa]; NEURAL_HAM_MEDIUM(-1.06)[-1.064]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[heuristicsystems.com.au:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.02)[-1.016]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_MED(-0.20)[203.41.22.115:from]; DKIM_TRACE(0.00)[heuristicsystems.com.au:+]; DMARC_NA(0.00)[heuristicsystems.com.au]; NEURAL_HAM_SHORT(-0.05)[-0.055]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:1221, ipnet:203.40.0.0/13, country:AU]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jun 2020 02:35:55 -0000 Hi Konstantin, I did try ktrace/kdump but kdump complained of "data too short". Using your suggestion about LD_DEBUG nearly caused me to fall off my chair. I think this is most relevant: # setenv LD_DEBUG 1 # ktrace -f /tmp/sq3.kt /usr/local/sbin/squid start /libexec/ld-elf.so.1 is initialized, base address = 0x8aded000 RTLD dynamic = 0x8ae0f6c0 RTLD pltgot = 0 initializing thread locks _rtld_thread_init: done processing main program's program header note osrel 1201517 note fctl0 0 note crt_no_init AT_EXECPATH 0xffffdfe0 /usr/bin/ktrace obj_main path /usr/bin/ktrace Filling in DT_DEBUG entry Ignoring d_tag 1879048186 = 0x6ffffffa /usr/bin/ktrace valid_hash_sysv 1 valid_hash_gnu 0 dynsymcount 30 lm_init("(null)") loading LD_PRELOAD libraries loading needed objects Searching for "libc.so.7" search_library_pathfds('libc.so.7', '(null)', fdp) lm_find("/usr/bin/ktrace", "/lib") lmp_find("/usr/bin/ktrace") lmp_find("$DEFAULT$") Trying "/lib/libc.so.7" Opened "/lib/libc.so.7", fd 3 loading "/lib/libc.so.7" Ignoring d_tag 1879048186 = 0x6ffffffa /lib/libc.so.7 valid_hash_sysv 1 valid_hash_gnu 1 dynsymcount 3126 0x6d20f000 .. 0x6d3eafff: /lib/libc.so.7 checking for required versions initializing initial thread local storage offsets relocating "/usr/bin/ktrace" reloc_jmpslot: *0x4b177c04 = 0x6d39bac0 reloc_jmpslot: *0x4b177c08 = 0x6d3b6480 ... [ Lots of these ] reloc_jmpslot: *0x9d4859fc = 0x9d46e560 reloc_jmpslot: *0x9d485a00 = 0x9d47a428 reloc_jmpslot: *0x9d485a04 = 0x9d47a448 relocating "/usr/local/lib/heimdal/libasn1.so.8" relocating "/usr/local/lib/heimdal/libwind.so.0" relocating "/usr/local/lib/heimdal/libheimbase.so.1" relocating "/usr/local/lib/heimdal/libhx509.so.5" relocating "/usr/local/lib/heimdal/libhcrypto.so.4" relocating "/usr/local/lib/heimdal/libheimsqlite.so.0" relocating "/usr/local/lib/heimdal/libcom_err.so.1" relocating "/usr/local/lib/heimdal/libroken.so.18" relocating "/usr/local/lib/libintl.so.8" relocating "/usr/local/lib/heimdal/libheimntlm.so.0" doing copy relocations initializing initial thread local storage initializing key program variables "__progname": *0x73be38b8 <-- 0xffffdd44 "environ": *0x73cbbc08 <-- 0xfffc69cc "__elf_aux_vector": *0x9d4a6a5c <-- 0xfffc6a4c resolving ifuncs reloc_jmpslot: *0x9d484d88 = 0x9d352cc0 reloc_jmpslot: *0x9d484d8c = 0x9d352c70 reloc_jmpslot: *0x9cb16e04 = 0x9d352c70 reloc_jmpslot: *0x9cb16e0c = 0x9d352cc0 calling init function for /lib/libc.so.7 at 0x9d47c440 calling init function for /lib/libc.so.7 at 0x9d40fc20 calling init function for /lib/libc.so.7 at 0x9d3f0f40 calling init function for /lib/libthr.so.3 at 0x9cb15210 calling init function for /lib/libthr.so.3 at 0x9cb10cb0 _rtld_thread_init: done calling init function for /lib/libgcc_s.so.1 at 0x9bfad540 calling init function for /lib/libgcc_s.so.1 at 0x9bfa3de0 calling init function for /lib/libcxxrt.so.1 at 0x9b698480 calling init function for /usr/lib/libc++.so.1 at 0x9ab43d90 calling init function for /usr/lib/libc++.so.1 at 0x9aae3e40 calling init function for /lib/libcrypt.so.5 at 0x965d3210 calling init function for /usr/local/lib/libcrypto.so.11 at 0x96e9f420 calling init function for /usr/local/lib/heimdal/libroken.so.18 at 0xa32b6f60 calling init function for /usr/local/lib/libintl.so.8 at 0xa23cb104 calling init function for /usr/local/lib/heimdal/libheimbase.so.1 at 0x9ed15de0 calling init function for /usr/local/lib/heimdal/libcom_err.so.1 at 0x9fec3768 calling init function for /usr/local/lib/heimdal/libasn1.so.8 at 0x9e23f054 calling init function for /usr/local/lib/heimdal/libhcrypto.so.4 at 0x9fb5641c calling init function for /usr/local/lib/heimdal/libheimsqlite.so.0 at 0xa1b9603c calling init function for /usr/local/lib/heimdal/libwind.so.0 at 0x9f77a990 calling init function for /usr/local/lib/heimdal/libhx509.so.5 at 0xa0c4e3b4 calling init function for /usr/local/lib/heimdal/libkrb5.so.26 at 0x99527188 calling init function for /usr/local/lib/heimdal/libheimntlm.so.0 at 0xa498c814 calling init function for /usr/local/lib/heimdal/libgssapi.so.3 at 0x9a45bfd0 calling init function for /usr/local/lib/libpcre.so.1 at 0x97550ca8 calling init function for /usr/local/lib/libpcreposix.so.0 at 0x9728e518 calling init function for /lib/libm.so.5 at 0x97139f10 calling init function for /usr/local/lib/libssl.so.11 at 0x98579078 calling init function for /usr/lib/libregex.so.1 at 0x95e8f0a0 calling init function for /usr/lib/librt.so.1 at 0x953ca240 loading filtees enforcing main obj relro transferring control to program entry point = 0x73757360 "atexit" in "squid" ==> 0x9d457ac0 in "libc.so.7" reloc_jmpslot: *0x73be32b4 = 0x9d457ac0 "_ZSt13set_terminatePFvvE" in "squid" ==> 0x9b697a30 in "libcxxrt.so.1" reloc_jmpslot: *0x73be3794 = 0x9b697a30 "strlen" in "squid" ==> 0x9d4750b0 in "libc.so.7" reloc_jmpslot: *0x73be3108 = 0x9d4750b0 "malloc" in "squid" ==> 0x9d3e6620 in "libc.so.7" reloc_jmpslot: *0x73be3820 = 0x9d3e6620 "memcpy" in "squid" ==> 0x9d47aa20 in "libc.so.7" reloc_jmpslot: *0x73be3500 = 0x9d47aa20 "_Znwj" in "squid" ==> 0x9ab437c0 in "libc++.so.1" reloc_jmpslot: *0x73be3578 = 0x9ab437c0 "free" in "squid" ==> 0x9d3e9ea0 in "libc.so.7" reloc_jmpslot: *0x73be3790 = 0x9d3e9ea0 "_ZdlPv" in "squid" ==> 0x9ab438d0 in "libc++.so.1" reloc_jmpslot: *0x73be32b8 = 0x9ab438d0 "getopt_long" in "squid" ==> 0x9d3515f0 in "libc.so.7" reloc_jmpslot: *0x73be3614 = 0x9d3515f0 Segmentation fault I've placed the ktrace (sq3.kt.xz) and LD_DEBUG output (sq.deb.xz) at http://www.heuristicsystems.com/squid4K Pity about ldd, but I appreciate the complexity & the effort. I'm also comforted that it isn't an error, rather the evolution of ldd :)