From owner-freebsd-git@freebsd.org Tue Oct 27 14:13:20 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C183944F23D for ; Tue, 27 Oct 2020 14:13:20 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CLDFX51Zyz4t17 for ; Tue, 27 Oct 2020 14:13:20 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [IPv6:2001:470:7a58:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 131682E7D1 for ; Tue, 27 Oct 2020 14:13:20 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from [IPv6:2001:470:7a58::424:16c3:e4c5:882c] (unknown [IPv6:2001:470:7a58:0:424:16c3:e4c5:882c]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 50D584DDC8 for ; Tue, 27 Oct 2020 15:13:17 +0100 (CET) From: Dimitry Andric Content-Type: multipart/signed; boundary="Apple-Mail=_F7F48345-2B4D-4BE5-A66F-5D6FA1394A90"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\)) Subject: https://cgit-beta.freebsd.org/src.git: error: RPC failed; curl 18 transfer closed with outstanding read data remaining Message-Id: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> Date: Tue, 27 Oct 2020 15:13:09 +0100 To: freebsd-git@freebsd.org X-Mailer: Apple Mail (2.3445.104.17) X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2020 14:13:20 -0000 --Apple-Mail=_F7F48345-2B4D-4BE5-A66F-5D6FA1394A90 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I consistently get this error when doing a "git fetch", on a already populated clone. This is with git 2.28.0, on a FreeBSD 13-CURRENT client. On the same system, git fetching over https from e.g. GitHub all work fine, even for the FreeBSD repository. Therefore, I am inclined to think that some cgit-beta server timeout setting is to blame. Verbose output: % GIT_CURL_VERBOSE=3D1 git fetch --prune 14:58:56.050029 http.c:756 =3D=3D Info: Couldn't find host = cgit-beta.freebsd.org in the .netrc file; using defaults 14:58:56.052120 http.c:756 =3D=3D Info: Trying = 2610:1c1:1:606c::16:65:443... 14:58:56.133920 http.c:756 =3D=3D Info: Connected to = cgit-beta.freebsd.org (2610:1c1:1:606c::16:65) port 443 (#0) 14:58:56.134850 http.c:756 =3D=3D Info: ALPN, offering h2 14:58:56.134869 http.c:756 =3D=3D Info: ALPN, offering = http/1.1 14:58:56.143526 http.c:756 =3D=3D Info: successfully set = certificate verify locations: 14:58:56.143547 http.c:756 =3D=3D Info: CAfile: = /usr/local/share/certs/ca-root-nss.crt CApath: none 14:58:56.143784 http.c:756 =3D=3D Info: TLSv1.3 (OUT), TLS = handshake, Client hello (1): 14:58:56.223672 http.c:756 =3D=3D Info: TLSv1.3 (IN), TLS = handshake, Server hello (2): 14:58:56.223736 http.c:756 =3D=3D Info: TLSv1.2 (IN), TLS = handshake, Certificate (11): 14:58:56.224258 http.c:756 =3D=3D Info: TLSv1.2 (IN), TLS = handshake, Server key exchange (12): 14:58:56.224341 http.c:756 =3D=3D Info: TLSv1.2 (IN), TLS = handshake, Server finished (14): 14:58:56.224468 http.c:756 =3D=3D Info: TLSv1.2 (OUT), TLS = handshake, Client key exchange (16): 14:58:56.224601 http.c:756 =3D=3D Info: TLSv1.2 (OUT), TLS = change cipher, Change cipher spec (1): 14:58:56.224677 http.c:756 =3D=3D Info: TLSv1.2 (OUT), TLS = handshake, Finished (20): 14:58:56.306638 http.c:756 =3D=3D Info: TLSv1.2 (IN), TLS = handshake, Finished (20): 14:58:56.306675 http.c:756 =3D=3D Info: SSL connection = using TLSv1.2 / ECDHE-RSA-CHACHA20-POLY1305 14:58:56.306681 http.c:756 =3D=3D Info: ALPN, server = accepted to use http/1.1 14:58:56.306688 http.c:756 =3D=3D Info: Server certificate: 14:58:56.306702 http.c:756 =3D=3D Info: subject: = CN=3Dcgit-beta.freebsd.org 14:58:56.306709 http.c:756 =3D=3D Info: start date: Aug 10 = 08:45:19 2020 GMT 14:58:56.306713 http.c:756 =3D=3D Info: expire date: Nov = 8 08:45:19 2020 GMT 14:58:56.306724 http.c:756 =3D=3D Info: subjectAltName: = host "cgit-beta.freebsd.org" matched cert's "cgit-beta.freebsd.org" 14:58:56.306734 http.c:756 =3D=3D Info: issuer: C=3DUS; = O=3DLet's Encrypt; CN=3DLet's Encrypt Authority X3 14:58:56.306737 http.c:756 =3D=3D Info: SSL certificate = verify ok. 14:58:56.306780 http.c:703 =3D> Send header, 0000000175 = bytes (0x000000af) 14:58:56.306826 http.c:715 =3D> Send header: GET = /src.git/info/refs?service=3Dgit-upload-pack HTTP/1.1 14:58:56.306829 http.c:715 =3D> Send header: Host: = cgit-beta.freebsd.org 14:58:56.306831 http.c:715 =3D> Send header: User-Agent: = git/2.28.0 14:58:56.306833 http.c:715 =3D> Send header: Accept: */* 14:58:56.306835 http.c:715 =3D> Send header: = Accept-Encoding: deflate, gzip 14:58:56.306837 http.c:715 =3D> Send header: Pragma: = no-cache 14:58:56.306840 http.c:715 =3D> Send header: 14:58:56.634261 http.c:756 =3D=3D Info: Mark bundle as not = supporting multiuse 14:58:56.634289 http.c:703 <=3D Recv header, 0000000017 = bytes (0x00000011) 14:58:56.634295 http.c:715 <=3D Recv header: HTTP/1.1 200 = OK 14:58:56.634298 http.c:703 <=3D Recv header, 0000000015 = bytes (0x0000000f) 14:58:56.634301 http.c:715 <=3D Recv header: Server: nginx 14:58:56.634304 http.c:703 <=3D Recv header, 0000000037 = bytes (0x00000025) 14:58:56.634307 http.c:715 <=3D Recv header: Date: Tue, 27 = Oct 2020 13:58:56 GMT 14:58:56.634310 http.c:703 <=3D Recv header, 0000000059 = bytes (0x0000003b) 14:58:56.634313 http.c:715 <=3D Recv header: Content-Type: = application/x-git-upload-pack-advertisement 14:58:56.634316 http.c:703 <=3D Recv header, 0000000028 = bytes (0x0000001c) 14:58:56.634319 http.c:715 <=3D Recv header: = Transfer-Encoding: chunked 14:58:56.634321 http.c:703 <=3D Recv header, 0000000024 = bytes (0x00000018) 14:58:56.634324 http.c:715 <=3D Recv header: Connection: = keep-alive 14:58:56.634327 http.c:703 <=3D Recv header, 0000000040 = bytes (0x00000028) 14:58:56.634329 http.c:715 <=3D Recv header: Expires: Fri, = 01 Jan 1980 00:00:00 GMT 14:58:56.634332 http.c:703 <=3D Recv header, 0000000018 = bytes (0x00000012) 14:58:56.634334 http.c:715 <=3D Recv header: Pragma: = no-cache 14:58:56.634337 http.c:703 <=3D Recv header, 0000000053 = bytes (0x00000035) 14:58:56.634340 http.c:715 <=3D Recv header: Cache-Control: = no-cache, max-age=3D0, must-revalidate 14:58:56.634342 http.c:703 <=3D Recv header, 0000000060 = bytes (0x0000003c) 14:58:56.634345 http.c:715 <=3D Recv header: = Strict-Transport-Security: max-age=3D3600; includeSubDomains 14:58:56.634348 http.c:703 <=3D Recv header, 0000000002 = bytes (0x00000002) 14:58:56.634351 http.c:715 <=3D Recv header: 14:58:58.221815 http.c:756 =3D=3D Info: Connection #0 to = host cgit-beta.freebsd.org left intact 14:58:58.302689 http.c:756 =3D=3D Info: Couldn't find host = cgit-beta.freebsd.org in the .netrc file; using defaults 14:58:58.302734 http.c:756 =3D=3D Info: Found bundle for = host cgit-beta.freebsd.org: 0x801243600 [serially] 14:58:58.302739 http.c:756 =3D=3D Info: Can not multiplex, = even if we wanted to! 14:58:58.302746 http.c:756 =3D=3D Info: Re-using existing = connection! (#0) with host cgit-beta.freebsd.org 14:58:58.302753 http.c:756 =3D=3D Info: Connected to = cgit-beta.freebsd.org (2610:1c1:1:606c::16:65) port 443 (#0) 14:58:58.302832 http.c:703 =3D> Send header, 0000000272 = bytes (0x00000110) 14:58:58.302839 http.c:715 =3D> Send header: POST = /src.git/git-upload-pack HTTP/1.1 14:58:58.302842 http.c:715 =3D> Send header: Host: = cgit-beta.freebsd.org 14:58:58.302844 http.c:715 =3D> Send header: User-Agent: = git/2.28.0 14:58:58.302846 http.c:715 =3D> Send header: = Accept-Encoding: deflate, gzip 14:58:58.302849 http.c:715 =3D> Send header: Content-Type: = application/x-git-upload-pack-request 14:58:58.302851 http.c:715 =3D> Send header: Accept: = application/x-git-upload-pack-result 14:58:58.302853 http.c:715 =3D> Send header: = Content-Encoding: gzip 14:58:58.302855 http.c:715 =3D> Send header: = Content-Length: 2118 14:58:58.302857 http.c:715 =3D> Send header: 14:58:58.302866 http.c:756 =3D=3D Info: upload completely = sent off: 2118 out of 2118 bytes 14:58:58.453929 http.c:756 =3D=3D Info: Mark bundle as not = supporting multiuse 14:58:58.453957 http.c:703 <=3D Recv header, 0000000017 = bytes (0x00000011) 14:58:58.453963 http.c:715 <=3D Recv header: HTTP/1.1 200 = OK 14:58:58.453967 http.c:703 <=3D Recv header, 0000000015 = bytes (0x0000000f) 14:58:58.453970 http.c:715 <=3D Recv header: Server: nginx 14:58:58.453972 http.c:703 <=3D Recv header, 0000000037 = bytes (0x00000025) 14:58:58.453975 http.c:715 <=3D Recv header: Date: Tue, 27 = Oct 2020 13:58:58 GMT 14:58:58.453979 http.c:703 <=3D Recv header, 0000000052 = bytes (0x00000034) 14:58:58.453981 http.c:715 <=3D Recv header: Content-Type: = application/x-git-upload-pack-result 14:58:58.453984 http.c:703 <=3D Recv header, 0000000028 = bytes (0x0000001c) 14:58:58.453987 http.c:715 <=3D Recv header: = Transfer-Encoding: chunked 14:58:58.453990 http.c:703 <=3D Recv header, 0000000024 = bytes (0x00000018) 14:58:58.453993 http.c:715 <=3D Recv header: Connection: = keep-alive 14:58:58.453995 http.c:703 <=3D Recv header, 0000000040 = bytes (0x00000028) 14:58:58.453998 http.c:715 <=3D Recv header: Expires: Fri, = 01 Jan 1980 00:00:00 GMT 14:58:58.454001 http.c:703 <=3D Recv header, 0000000018 = bytes (0x00000012) 14:58:58.454003 http.c:715 <=3D Recv header: Pragma: = no-cache 14:58:58.454006 http.c:703 <=3D Recv header, 0000000053 = bytes (0x00000035) 14:58:58.454008 http.c:715 <=3D Recv header: Cache-Control: = no-cache, max-age=3D0, must-revalidate 14:58:58.454011 http.c:703 <=3D Recv header, 0000000060 = bytes (0x0000003c) 14:58:58.454013 http.c:715 <=3D Recv header: = Strict-Transport-Security: max-age=3D3600; includeSubDomains 14:58:58.454017 http.c:703 <=3D Recv header, 0000000002 = bytes (0x00000002) 14:58:58.454019 http.c:715 <=3D Recv header: ... dozens of screenfuls of this ... 14:59:34.090471 http.c:756 =3D=3D Info: Connection #0 to = host cgit-beta.freebsd.org left intact 14:59:34.090512 http.c:756 =3D=3D Info: Couldn't find host = cgit-beta.freebsd.org in the .netrc file; using defaults 14:59:34.090551 http.c:756 =3D=3D Info: Found bundle for = host cgit-beta.freebsd.org: 0x801243600 [serially] 14:59:34.090561 http.c:756 =3D=3D Info: Can not multiplex, = even if we wanted to! 14:59:34.090567 http.c:756 =3D=3D Info: Re-using existing = connection! (#0) with host cgit-beta.freebsd.org 14:59:34.090574 http.c:756 =3D=3D Info: Connected to = cgit-beta.freebsd.org (2610:1c1:1:606c::16:65) port 443 (#0) 14:59:34.090772 http.c:703 =3D> Send header, 0000000254 = bytes (0x000000fe) 14:59:34.090792 http.c:715 =3D> Send header: POST = /src.git/git-upload-pack HTTP/1.1 14:59:34.090796 http.c:715 =3D> Send header: Host: = cgit-beta.freebsd.org 14:59:34.090798 http.c:715 =3D> Send header: User-Agent: = git/2.28.0 14:59:34.090800 http.c:715 =3D> Send header: = Accept-Encoding: deflate, gzip 14:59:34.090803 http.c:715 =3D> Send header: Content-Type: = application/x-git-upload-pack-request 14:59:34.090805 http.c:715 =3D> Send header: Accept: = application/x-git-upload-pack-result 14:59:34.090807 http.c:715 =3D> Send header: = Transfer-Encoding: chunked 14:59:34.090809 http.c:715 =3D> Send header: 14:59:36.012604 http.c:756 =3D=3D Info: Signaling end of = chunked upload via terminating chunk. 14:59:36.370298 http.c:756 =3D=3D Info: Mark bundle as not = supporting multiuse 14:59:36.370330 http.c:703 <=3D Recv header, 0000000017 = bytes (0x00000011) 14:59:36.370336 http.c:715 <=3D Recv header: HTTP/1.1 200 = OK 14:59:36.370340 http.c:703 <=3D Recv header, 0000000015 = bytes (0x0000000f) 14:59:36.370342 http.c:715 <=3D Recv header: Server: nginx 14:59:36.370345 http.c:703 <=3D Recv header, 0000000037 = bytes (0x00000025) 14:59:36.370348 http.c:715 <=3D Recv header: Date: Tue, 27 = Oct 2020 13:59:34 GMT 14:59:36.370351 http.c:703 <=3D Recv header, 0000000052 = bytes (0x00000034) 14:59:36.370354 http.c:715 <=3D Recv header: Content-Type: = application/x-git-upload-pack-result 14:59:36.370357 http.c:703 <=3D Recv header, 0000000028 = bytes (0x0000001c) 14:59:36.370359 http.c:715 <=3D Recv header: = Transfer-Encoding: chunked 14:59:36.370362 http.c:703 <=3D Recv header, 0000000024 = bytes (0x00000018) 14:59:36.370365 http.c:715 <=3D Recv header: Connection: = keep-alive 14:59:36.370367 http.c:703 <=3D Recv header, 0000000040 = bytes (0x00000028) 14:59:36.370370 http.c:715 <=3D Recv header: Expires: Fri, = 01 Jan 1980 00:00:00 GMT 14:59:36.370373 http.c:703 <=3D Recv header, 0000000018 = bytes (0x00000012) 14:59:36.370375 http.c:715 <=3D Recv header: Pragma: = no-cache 14:59:36.370378 http.c:703 <=3D Recv header, 0000000053 = bytes (0x00000035) 14:59:36.370380 http.c:715 <=3D Recv header: Cache-Control: = no-cache, max-age=3D0, must-revalidate 14:59:36.370383 http.c:703 <=3D Recv header, 0000000060 = bytes (0x0000003c) 14:59:36.370385 http.c:715 <=3D Recv header: = Strict-Transport-Security: max-age=3D3600; includeSubDomains 14:59:36.370389 http.c:703 <=3D Recv header, 0000000002 = bytes (0x00000002) 14:59:36.370391 http.c:715 <=3D Recv header: 15:01:18.716556 http.c:756 =3D=3D Info: transfer closed = with outstanding read data remaining 15:01:18.716613 http.c:756 =3D=3D Info: Closing connection = 0 15:01:18.716765 http.c:756 =3D=3D Info: TLSv1.2 (OUT), TLS = alert, close notify (256): error: RPC failed; curl 18 transfer closed with outstanding read data = remaining fatal: the remote end hung up unexpectedly So the server is not giving any answer for about 102 seconds, then apparently the client hangs up? Is the server just extremely slow? -Dimitry --Apple-Mail=_F7F48345-2B4D-4BE5-A66F-5D6FA1394A90 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCX5gq9QAKCRCwXqMKLiCW o4/mAJ9zuRc0urIVKQbH5tp036wIfOQKEQCgzo57CCAM2zoeBZOkVp7BpxmhnGw= =tBUP -----END PGP SIGNATURE----- --Apple-Mail=_F7F48345-2B4D-4BE5-A66F-5D6FA1394A90-- From owner-freebsd-git@freebsd.org Tue Oct 27 14:31:02 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 92A0644FC04 for ; Tue, 27 Oct 2020 14:31:02 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CLDdy02G7z4vDG; Tue, 27 Oct 2020 14:31:01 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.16.1/8.15.2) with ESMTP id 09REUrl1025507; Tue, 27 Oct 2020 14:30:53 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.16.1/8.16.1/Submit) id 09REUrDj025506; Tue, 27 Oct 2020 07:30:53 -0700 (PDT) (envelope-from david) Date: Tue, 27 Oct 2020 07:30:53 -0700 From: David Wolfskill To: Dimitry Andric Cc: freebsd-git@freebsd.org Subject: Re: https://cgit-beta.freebsd.org/src.git: error: RPC failed; curl 18 transfer closed with outstanding read data remaining Message-ID: <20201027143053.GJ1430@albert.catwhisker.org> References: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="7UxcOAJ07vnNm5/N" Content-Disposition: inline In-Reply-To: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> X-Rspamd-Queue-Id: 4CLDdy02G7z4vDG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; REPLY(-4.00)[] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Oct 2020 14:31:02 -0000 --7UxcOAJ07vnNm5/N Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 27, 2020 at 03:13:09PM +0100, Dimitry Andric wrote: > I consistently get this error when doing a "git fetch", on a already > populated clone. This is with git 2.28.0, on a FreeBSD 13-CURRENT > client. On the same system, git fetching over https from e.g. GitHub all > work fine, even for the FreeBSD repository. Therefore, I am inclined to > think that some cgit-beta server timeout setting is to blame. >=20 > Verbose output: >=20 > % GIT_CURL_VERBOSE=3D1 git fetch --prune > ... Hmmm... My experience differs: I'm not seeing an issue. Some (likely) differences between our environments: * I'm running stable/12 when I update my local private mirror. * I'm only using IPv4 (in case you might be using IPv6). * As hinted at above, I'm updating a mirror -- created via "git clone --mirror https://cgit-beta.freebsd.org/src.git" * Thus, the fetch is "git fecth --all" > 15:01:18.716765 http.c:756 =3D=3D Info: TLSv1.2 (OUT), TLS a= lert, close notify (256): > error: RPC failed; curl 18 transfer closed with outstanding read data rem= aining > fatal: the remote end hung up unexpectedly >=20 > So the server is not giving any answer for about 102 seconds, then > apparently the client hangs up? Is the server just extremely slow? > ... I haven't tried a verbose invocation (as I haven't been seeing a problem), but here are some timestamps to illustrate what I'm seeing: g1-55(12.2-S)[4] grep '^git ' /var/log/git.log | tail -12 git repo sync started at Mon Oct 26 10:15:00 UTC 2020 git repo sync for src ended at Mon Oct 26 10:15:01 UTC 2020 exit status 0 git repo sync for ports ended at Mon Oct 26 10:15:02 UTC 2020 exit status 0 git repo sync for doc ended at Mon Oct 26 10:15:02 UTC 2020 exit status 0 git repo sync started at Tue Oct 27 09:15:00 UTC 2020 git repo sync for src ended at Tue Oct 27 09:16:03 UTC 2020 exit status 0 git repo sync for ports ended at Tue Oct 27 09:16:41 UTC 2020 exit status 0 git repo sync for doc ended at Tue Oct 27 09:16:48 UTC 2020 exit status 0 git repo sync started at Tue Oct 27 10:15:00 UTC 2020 git repo sync for src ended at Tue Oct 27 10:15:02 UTC 2020 exit status 0 git repo sync for ports ended at Tue Oct 27 10:15:02 UTC 2020 exit status 0 git repo sync for doc ended at Tue Oct 27 10:15:02 UTC 2020 exit status 0 For the src update that started Tue Oct 27 09:15:00 UTC 2020, I see: git repo sync started at Tue Oct 27 09:15:00 UTC 2020 Fetching origin =46rom https://cgit-beta.freebsd.org/src a381af222511..eb90a5ae1f41 main -> main 39483f16a15e..22fd9e462f15 stable/11 -> stable/11 0830a1fadd0b..7eb4feecfd75 stable/12 -> stable/12 + 63cd65e9aa40...311dd869130d refs/notes/commits -> refs/notes/commits (f= orced update) git repo sync for src ended at Tue Oct 27 09:16:03 UTC 2020 exit status 0 While I'm certain that won't solve the issue for you, I hope it helps somoewhat. Peace, david --=20 David H. Wolfskill david@catwhisker.org Donald Trump: the pandemic is "rounding the turn." (WH Chief of Staff) Mark Meadows: "We are not going to control the pandemic." See http://www.catwhisker.org/~david/publickey.gpg for my public key. --7UxcOAJ07vnNm5/N Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEE4owz2QxMJyaxAefyQLJg+bY2PckFAl+YLx1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEUy OEMzM0Q5MEM0QzI3MjZCMTAxRTdGMjQwQjI2MEY5QjYzNjNEQzkACgkQQLJg+bY2 PcnQOwf+ObuKFk7mtIHyNlYlGGGDqVyniXfNgUdWPeYXtWiH62wwG34A5y4o2ZcR a69B+Rh3aSdHN5O9CpAZM4kg/4ndyDE4Ip2Fzx/ZBRBys9CLTWES7ESMbt3hG4Dg 6c6PyYlekfQWz2sM628zDj0o1yovpGIYU6Veu0DwGXb3KSb0TawDu6BtdKiSLPst G9Q8tmpoefEV4MznD/P/AEOQ6knTYAHJeMSJxdeso5g0lu4v9X9/wHSniTcQVR5V oQXVYCX453op+y9dbAm10yTOHMhHxqzgOm8gWB16OhaaGsBEatoh0Up3+sJf+D5T 9OyK+wT/rhwCWajGJK1Ej9bNLTvInA== =HaLn -----END PGP SIGNATURE----- --7UxcOAJ07vnNm5/N-- From owner-freebsd-git@freebsd.org Wed Oct 28 19:54:11 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 89C0744F0B4 for ; Wed, 28 Oct 2020 19:54:11 +0000 (UTC) (envelope-from uqs@freebsd.org) Received: from acme.spoerlein.net (acme.spoerlein.net [IPv6:2a05:fc87:1:5::15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.spoerlein.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CLzmL6T02z4WXK; Wed, 28 Oct 2020 19:54:10 +0000 (UTC) (envelope-from uqs@freebsd.org) Received: from localhost (acme.spoerlein.net [IPv6:2a05:fc87:1:5:0:0:0:15]) by acme.spoerlein.net (8.15.2/8.15.2) with ESMTPS id 09SJs1Me042109 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 28 Oct 2020 20:54:02 +0100 (CET) (envelope-from uqs@freebsd.org) Date: Wed, 28 Oct 2020 20:54:01 +0100 From: Ulrich =?utf-8?B?U3DDtnJsZWlu?= To: Dimitry Andric Cc: freebsd-git@freebsd.org Subject: Re: https://cgit-beta.freebsd.org/src.git: error: RPC failed; curl 18 transfer closed with outstanding read data remaining Message-ID: <20201028195401.GR92039@acme.spoerlein.net> References: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> User-Agent: Mutt/1.14.6 (2020-07-11) X-Rspamd-Queue-Id: 4CLzmL6T02z4WXK X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:39540, ipnet:2a05:fc87::/32, country:CH]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2020 19:54:11 -0000 On Tue, 2020-10-27 at 15:13:09 +0100, Dimitry Andric wrote: > I consistently get this error when doing a "git fetch", on a already > populated clone. This is with git 2.28.0, on a FreeBSD 13-CURRENT > client. On the same system, git fetching over https from e.g. GitHub all > work fine, even for the FreeBSD repository. Therefore, I am inclined to > think that some cgit-beta server timeout setting is to blame. Hi Dim just to make sure, as you explicitly write "on an already populated clone", does this also happen with a fresh clone? I think the aggressive repacking between runs is to blame here, as that takes away the potential to send a small diff update. I've now reverted the aggressive GC and have changed the conversion to run 3x per day per repo. (We no longer need the aggressive repack, it was put in place to fix something else :) IOW, please try a fresh clone, and if the future `fetches` to this clone continue timing out over the next few days, we can have another look. Sorry for the inconvenience, Uli From owner-freebsd-git@freebsd.org Wed Oct 28 20:30:28 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 89AD744FA3F for ; Wed, 28 Oct 2020 20:30:28 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM0ZD3627z4Xt2; Wed, 28 Oct 2020 20:30:28 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [IPv6:2001:470:7a58:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 2169E1BBF9; Wed, 28 Oct 2020 20:30:28 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from [IPv6:2001:470:7a58::d5a9:e499:15e6:a113] (unknown [IPv6:2001:470:7a58:0:d5a9:e499:15e6:a113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 224636E9D2; Wed, 28 Oct 2020 21:30:26 +0100 (CET) From: Dimitry Andric Message-Id: <6A9E2766-8C64-4880-95CA-990D2589304C@FreeBSD.org> Content-Type: multipart/signed; boundary="Apple-Mail=_9A85CAAB-1773-4DD4-B86A-2B31831EF78E"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\)) Subject: Re: https://cgit-beta.freebsd.org/src.git: error: RPC failed; curl 18 transfer closed with outstanding read data remaining Date: Wed, 28 Oct 2020 21:30:18 +0100 In-Reply-To: <20201028195401.GR92039@acme.spoerlein.net> Cc: freebsd-git@freebsd.org To: =?utf-8?Q?Ulrich_Sp=C3=B6rlein?= References: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> <20201028195401.GR92039@acme.spoerlein.net> X-Mailer: Apple Mail (2.3445.104.17) X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2020 20:30:28 -0000 --Apple-Mail=_9A85CAAB-1773-4DD4-B86A-2B31831EF78E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 On 28 Oct 2020, at 20:54, Ulrich Sp=C3=B6rlein wrote: >=20 > On Tue, 2020-10-27 at 15:13:09 +0100, Dimitry Andric wrote: >> I consistently get this error when doing a "git fetch", on a already >> populated clone. This is with git 2.28.0, on a FreeBSD 13-CURRENT >> client. On the same system, git fetching over https from e.g. GitHub = all >> work fine, even for the FreeBSD repository. Therefore, I am inclined = to >> think that some cgit-beta server timeout setting is to blame. >=20 > Hi Dim >=20 > just to make sure, as you explicitly write "on an already populated > clone", does this also happen with a fresh clone? >=20 > I think the aggressive repacking between runs is to blame here, as = that > takes away the potential to send a small diff update. I've now = reverted > the aggressive GC and have changed the conversion to run 3x per day = per > repo. (We no longer need the aggressive repack, it was put in place to > fix something else :) >=20 > IOW, please try a fresh clone, and if the future `fetches` to this = clone > continue timing out over the next few days, we can have another look. Yes, this was precisely the advice I got the last time. :) I had my fresh clone then, which is now a little bit less fresh, and I want to update it, that's really all. Am I really expected to clone the whole thing every time...? That said, I'm unsure if you use bitmaps on the server side, which should speed up operations like this. Are these enabled? -Dimitry --Apple-Mail=_9A85CAAB-1773-4DD4-B86A-2B31831EF78E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCX5nU2gAKCRCwXqMKLiCW owXZAJ0TgAch9fO3XQ3ufQOJoAgybiBbrQCgxjKjpSEnAkefO+OvsQ0EahOTYfg= =pHtX -----END PGP SIGNATURE----- --Apple-Mail=_9A85CAAB-1773-4DD4-B86A-2B31831EF78E-- From owner-freebsd-git@freebsd.org Thu Oct 29 13:08:53 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 300C44509BB for ; Thu, 29 Oct 2020 13:08:53 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: from mail-oi1-f177.google.com (mail-oi1-f177.google.com [209.85.167.177]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CMQkD29fnz3TR8; Thu, 29 Oct 2020 13:08:52 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: by mail-oi1-f177.google.com with SMTP id u127so3096965oib.6; Thu, 29 Oct 2020 06:08:52 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=sJp1s//tkKRYOdrhKZQmCM1Y/n1jzH9b3sSjayOkYmk=; b=tZ1L1XjahixARB2Vw+nzJVd2DAnMn69jrpwMjyxcMbQ5nlv1ryxnOc3yWkfc0eRwoQ Nnp2MJSs16dTy48h4oSnmpQN/mHz1LLJ4Z8Mi7/S1o9jjTWzYsXncouILSqG7XxRd8/7 ID7Oexu7kAGECqNDQp8XnxIkuDvSXVo/nEjVVDkChc1lVvvxSBhVlYuDYtmR9Pk52COG fwgwNkv425wU+XOhbeGNZQpbXN8QfiVOwNftHD2vvd3Qnf/DHb9YIBsKjra2wd1CfDJE 7RFWm4Lc7HtCBBqS11GaO7t8zBca0Rv9lLKGeIQk569fFkYRiV8fVvnmpkZ6Lsh44MVz JoKQ== X-Gm-Message-State: AOAM530GiGek4ELVI5zoZ/Zae/zAp/voZRebzMUKjkBCiGaaR2cvaMaA 5fLGhONrQTEQo7jli5IbKntXBu+SjSFF2sIETkxDioiw X-Google-Smtp-Source: ABdhPJzSWWjJx8WF4keeluHZSJu8pn8/0L1YD6rhfnI00N951SR5V1MFjdu42mzHBpnFnoPb2uPAlMQ2nxCSnWjHqXY= X-Received: by 2002:aca:b141:: with SMTP id a62mr2607905oif.101.1603976929963; Thu, 29 Oct 2020 06:08:49 -0700 (PDT) MIME-Version: 1.0 References: <4260438E-0F95-4A59-8CD1-7DCF47B56D45@FreeBSD.org> <20201028195401.GR92039@acme.spoerlein.net> <6A9E2766-8C64-4880-95CA-990D2589304C@FreeBSD.org> In-Reply-To: <6A9E2766-8C64-4880-95CA-990D2589304C@FreeBSD.org> From: =?UTF-8?Q?Ulrich_Sp=C3=B6rlein?= Date: Thu, 29 Oct 2020 14:08:25 +0100 Message-ID: Subject: Re: https://cgit-beta.freebsd.org/src.git: error: RPC failed; curl 18 transfer closed with outstanding read data remaining To: Dimitry Andric Cc: freebsd-git@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4CMQkD29fnz3TR8 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2020 13:08:53 -0000 On Wed, Oct 28, 2020 at 9:30 PM Dimitry Andric wrote: > > On 28 Oct 2020, at 20:54, Ulrich Sp=C3=B6rlein wrote: > > > > On Tue, 2020-10-27 at 15:13:09 +0100, Dimitry Andric wrote: > >> I consistently get this error when doing a "git fetch", on a already > >> populated clone. This is with git 2.28.0, on a FreeBSD 13-CURRENT > >> client. On the same system, git fetching over https from e.g. GitHub a= ll > >> work fine, even for the FreeBSD repository. Therefore, I am inclined t= o > >> think that some cgit-beta server timeout setting is to blame. > > > > Hi Dim > > > > just to make sure, as you explicitly write "on an already populated > > clone", does this also happen with a fresh clone? > > > > I think the aggressive repacking between runs is to blame here, as that > > takes away the potential to send a small diff update. I've now reverted > > the aggressive GC and have changed the conversion to run 3x per day per > > repo. (We no longer need the aggressive repack, it was put in place to > > fix something else :) > > > > IOW, please try a fresh clone, and if the future `fetches` to this clon= e > > continue timing out over the next few days, we can have another look. > > Yes, this was precisely the advice I got the last time. :) > > I had my fresh clone then, which is now a little bit less fresh, and I > want to update it, that's really all. Am I really expected to clone the > whole thing every time...? > > That said, I'm unsure if you use bitmaps on the server side, which > should speed up operations like this. Are these enabled? No idea if these were enabled or not. But as I wrote, the aggressive repack= ing has only been turned off last night. So, does the problem currently persist? It would be strange if you're the only one running into this ... Uli