From owner-freebsd-questions@freebsd.org Sun Jan 10 15:41:58 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E7BC94D0924 for ; Sun, 10 Jan 2021 15:41:58 +0000 (UTC) (envelope-from jkeenan@pobox.com) Received: from pb-smtp21.pobox.com (pb-smtp21.pobox.com [173.228.157.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DDLgB099Vz4nsT for ; Sun, 10 Jan 2021 15:41:57 +0000 (UTC) (envelope-from jkeenan@pobox.com) Received: from pb-smtp21.pobox.com (unknown [127.0.0.1]) by pb-smtp21.pobox.com (Postfix) with ESMTP id 40E9111BCBC; Sun, 10 Jan 2021 10:41:56 -0500 (EST) (envelope-from jkeenan@pobox.com) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=to:from :subject:message-id:date:mime-version:content-type :content-transfer-encoding; s=sasl; bh=A9qgzB8VY6xHYcT6vxo0ILeLF e8=; b=EgnDmWuoTxGp+D09N2KozRj/SEqqhOk1aM/STUk+XwWpMbmOqQP2uc0KI 1+LRggbVsMEF8ivt0IcWFaSrt3dchn/U+R4xaW4h+vWMSEnnfUGVpjBTDr0DmGVE Vr1PHBkNeD8OXV0POBgLIZAD3tmrjfXcfZnC8gG+Tiy4tj95NM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=pobox.com; h=to:from:subject :message-id:date:mime-version:content-type :content-transfer-encoding; q=dns; s=sasl; b=lyNfsNqjJ25G7P54dI2 fdNIW7wIvDn6YzjfIvXVKqybwVz/Vy3iwfQ8I7EFr+r8ARcwH+GVjf3SRFiIaB1q VoyToKPN64wxHVIMtJZ2n+Q8fsNwZzVkE3NYvp4m+EgyHbNYjXTxexGfevLngw4/ wYHmQpA4c3Xixx7Xlew8qlHM= Received: from pb-smtp21.sea.icgroup.com (unknown [127.0.0.1]) by pb-smtp21.pobox.com (Postfix) with ESMTP id 3982211BCBA; Sun, 10 Jan 2021 10:41:56 -0500 (EST) (envelope-from jkeenan@pobox.com) Received: from [192.168.1.4] (unknown [24.185.115.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pb-smtp21.pobox.com (Postfix) with ESMTPSA id 86C7E11BCB7; Sun, 10 Jan 2021 10:41:53 -0500 (EST) (envelope-from jkeenan@pobox.com) To: freebsd-questions@freebsd.org From: James E Keenan Subject: wget hung at "Initiating handshake"; version upgrade made things worse Message-ID: <17692bb2-7472-4a20-bd8f-05684f209b66@pobox.com> Date: Sun, 10 Jan 2021 10:41:51 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US X-Pobox-Relay-ID: 5D08F906-535A-11EB-A0B6-D609E328BF65-57062903!pb-smtp21.pobox.com Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4DDLgB099Vz4nsT X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=pobox.com header.s=sasl header.b=EgnDmWuo; dmarc=pass (policy=none) header.from=pobox.com; spf=pass (mx1.freebsd.org: domain of jkeenan@pobox.com designates 173.228.157.53 as permitted sender) smtp.mailfrom=jkeenan@pobox.com X-Spamd-Result: default: False [-4.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:173.228.157.0/24]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[pobox.com:+]; DMARC_POLICY_ALLOW(-0.50)[pobox.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[24.185.115.142:received]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[173.228.157.53:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:173.228.157.0/24, country:US]; DWL_DNSWL_NONE(0.00)[pobox.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[pobox.com:s=sasl]; RCVD_IN_DNSWL_LOW(-0.10)[173.228.157.53:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[173.228.157.53:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jan 2021 15:41:59 -0000 This is a two-stage problem, i.e., a case where what I did to correct a=20 problem in Stage 1 only got me into a worse problem in Stage 2. Stage 1 On FreeBSD-11, using wget 1.19.5, I was attempting to download a tarball=20 in a way I have done dozens of times previously. (I'll show debug and=20 verbose output.) ##### $ wget -dv https://www.cpan.org/src/5.0/perl-5.32.1-RC1.tar.gz Setting --verbose (verbose) to 1 Setting --verbose (verbose) to 1 DEBUG output created by Wget 1.19.5 on freebsd11.1. Reading HSTS entries from /home/jkeenan/.wget-hsts URI encoding =3D 'US-ASCII' converted 'https://www.cpan.org/src/5.0/perl-5.32.1-RC1.tar.gz'=20 (US-ASCII) -> 'https://www.cpan.org/src/5.0/perl-5.32.1-RC1.tar.gz' (UTF-= 8) Converted file name 'perl-5.32.1-RC1.tar.gz' (UTF-8) ->=20 'perl-5.32.1-RC1.tar.gz' (US-ASCII) --2021-01-10 14:56:49-- https://www.cpan.org/src/5.0/perl-5.32.1-RC1.tar= .gz Resolving www.cpan.org (www.cpan.org)... 151.101.2.132, 151.101.66.132,=20 151.101.130.132, ... Caching www.cpan.org =3D> 151.101.2.132 151.101.66.132 151.101.130.132=20 151.101.194.132 2a04:4e42::644 2a04:4e42:200::644 2a04:4e42:400::644=20 2a04:4e42:600::644 Connecting to www.cpan.org (www.cpan.org)|151.101.2.132|:443... connected= . Created socket 3. Releasing 0x0000000802371680 (new refcount 1). Initiating SSL handshake. ##### At this point wget hung indefinitely. In contrast (a) wget was able to=20 download a different tarball from an http site; (b) wget successfully=20 loaded the same (perl release candidate) tarball on Linux. Picking up=20 from `Initiating SSL handshake.`, on Linux I got output like this: ##### ... Initiating SSL handshake. Handshake successful; connected socket 3 to SSL handle 0x0000555575f73080 certificate: subject: CN=3D*.cpan.org issuer: CN=3DR3,O=3DLet's Encrypt,C=3DUS X509 certificate successfully verified and matches host www.cpan.org ---request begin--- GET /src/5.0/perl-5.32.1-RC1.tar.gz HTTP/1.1 User-Agent: Wget/1.20.3 (linux-gnu) Accept: */* Accept-Encoding: identity Host: www.cpan.org Connection: Keep-Alive ---request end--- HTTP request sent, awaiting response... ---response begin--- HTTP/1.1 200 OK Connection: keep-alive Content-Length: 18040350 Server: Apache/2.4.41 (Unix) Last-Modified: Sat, 09 Jan 2021 16:48:26 GMT ETag: "113461e-5b87a7110ca80" Cache-Control: public, max-age=3D172800, stale-while-revalidate=3D90,=20 stale-if-error=3D172800 Content-Type: application/x-gzip Via: 1.1 varnish, 1.1 varnish Strict-Transport-Security: max-age=3D15724800; Accept-Ranges: bytes Age: 43433 Date: Sun, 10 Jan 2021 15:08:43 GMT X-Served-By: cache-fra19165-FRA, cache-ewr18172-EWR X-Cache: HIT, HIT X-Cache-Hits: 0, 0 X-Timer: S1610291324.941590,VS0,VE1 ---response end--- 200 OK Registered socket 3 for persistent reuse. Parsed Strict-Transport-Security max-age =3D 15724800, includeSubDomains = =3D=20 false Updated HSTS host: www.cpan.org:443 (max-age: 15724800,=20 includeSubdomains: false) Length: 18040350 (17M) [application/x-gzip] Saving to: =E2=80=98perl-5.32.1-RC1.tar.gz.1=E2=80=99 perl-5.32.1-RC1.tar.gz.1 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>]=20 17.20M 5.95MB/s in 2.9s 2021-01-10 10:08:46 (5.95 MB/s) - =E2=80=98perl-5.32.1-RC1.tar.gz.1=E2=80= =99 saved=20 [18040350/18040350] Saving HSTS entries to /home/jkeenan/.wget-hsts ##### So in Stage 1, the problem was that on FreeBSD-11, wget failed to=20 complete the handshake in a usage I had accomplished many times previousl= y. Stage 2 I noted that the version of wget I was using on FreeBSD-11 was behind=20 that which I was using on Linux. So I attempted to upgrade wget.=20 Upshot: now my wget is unusable. ##### $ sudo pkg install wget Updating FreeBSD repository catalogue... Fetching meta.txz: 100% 916 B 0.9kB/s 00:01 Fetching packagesite.txz: 100% 6 MiB 6.0MB/s 00:01 Processing entries: 0% Newer FreeBSD version for package py37-mysqlclient: To ignore this error set IGNORE_OSVERSION=3Dyes - package: 1104001 - running kernel: 1102503 Ignore the mismatch and continue? [y/N]: y Processing entries: 100% FreeBSD repository update completed. 28863 packages processed. All repositories are up to date. New version of pkg detected; it needs to be installed first. The following 1 package(s) will be affected (of 0 checked): Installed packages to be UPGRADED: pkg: 1.15.4 -> 1.16.1 Number of packages to be upgraded: 1 4 MiB to be downloaded. Proceed with this action? [y/N]: y [1/1] Fetching pkg-1.16.1.txz: 100% 4 MiB 3.7MB/s 00:01 Checking integrity... done (0 conflicting) [1/1] Upgrading pkg from 1.15.4 to 1.16.1... [1/1] Extracting pkg-1.16.1: 100% Updating FreeBSD repository catalogue... FreeBSD repository is up to date. All repositories are up to date. The following 1 package(s) will be affected (of 0 checked): Installed packages to be UPGRADED: wget: 1.19.5 -> 1.20.3_1 Number of packages to be upgraded: 1 650 KiB to be downloaded. Proceed with this action? [y/N]: y [1/1] Fetching wget-1.20.3_1.txz: 100% 650 KiB 666.1kB/s 00:01 Checking integrity... done (0 conflicting) [1/1] Upgrading wget from 1.19.5 to 1.20.3_1... [1/1] Extracting wget-1.20.3_1: 100% $ wget -dv https://www.cpan.org/src/5.0/perl-5.32.1-RC1.tar.gz /lib/libc.so.7: version FBSD_1.6 required by /usr/local/bin/wget not foun= d ##### So my upgrade to wget-1.20 on FreeBSD-11 was not successful. I can't=20 even use it on non-https sites. I do have /lib/libc.so.7: ##### $ ls -l /lib/libc.so.7 -r--r--r-- 1 root wheel 1760360 Oct 20 2018 /lib/libc.so.7 ##### But wget is not happy with that. Does anyone have suggestions as to either (a) what was going wrong in=20 Stage 1; or (b) how I can get myself out of the rabbit hole in Stage 2? Thank you very much. Jim Keenan