From owner-freebsd-ports@freebsd.org Sun Apr 11 01:34:32 2021 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4A04D5DE5B3 for ; Sun, 11 Apr 2021 01:34:32 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vtr.rulingia.com (vtr.rulingia.com [IPv6:2001:19f0:5801:ebe:5400:1ff:fe53:30fd]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "vtr.rulingia.com", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FHvYL5vDFz4dlV for ; Sun, 11 Apr 2021 01:34:30 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) by vtr.rulingia.com (8.16.1/8.15.2) with ESMTPS id 13B1YKv8014684 (version=TLSv1.3 cipher=AEAD-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 11 Apr 2021 11:34:26 +1000 (AEST) (envelope-from peter@rulingia.com) DKIM-Filter: OpenDKIM Filter v2.10.3 vtr.rulingia.com 13B1YKv8014684 X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.16.1/8.16.1) with ESMTPS id 13B1Y7Xu053362 (version=TLSv1.3 cipher=AEAD-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 11 Apr 2021 11:34:09 +1000 (AEST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.16.1/8.16.1/Submit) id 13B1Y74X053361; Sun, 11 Apr 2021 11:34:07 +1000 (AEST) (envelope-from peter) Date: Sun, 11 Apr 2021 11:34:07 +1000 From: Peter Jeremy To: Trev Cc: freebsd-ports@freebsd.org Subject: gitup issues [was Re: No update for a day on ports?] Message-ID: References: <20210401082247.668e4394@zeta.dino.sk> <3b7de439-12a1-70a4-7aec-8b2a9fde38ba@heuristicsystems.com.au> <20210401095527.7de7a28e@raksha.tavi.co.uk> <340c035b-705d-de21-86d1-6c749ac8174c@druid.net> <4227bf01-4733-bc76-3188-57d9478ac15e@sentry.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ebf+MdYvR7TaN1Li" Content-Disposition: inline In-Reply-To: <4227bf01-4733-bc76-3188-57d9478ac15e@sentry.org> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp X-Rspamd-Queue-Id: 4FHvYL5vDFz4dlV X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.86 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[rulingia.com:s=default]; FREEFALL_USER(0.00)[peter]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_SPAM_SHORT(0.24)[0.237]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; SPAMHAUS_ZRD(0.00)[2001:19f0:5801:ebe:5400:1ff:fe53:30fd:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[rulingia.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[rulingia.com,quarantine]; NEURAL_SPAM_LONG(1.00)[1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:19f0:5801:ebe:5400:1ff:fe53:30fd:from]; ASN(0.00)[asn:20473, ipnet:2001:19f0:5800::/38, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-ports]; SUBJECT_HAS_QUESTION(0.00)[] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Apr 2021 01:34:32 -0000 --ebf+MdYvR7TaN1Li Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2021-Apr-01 22:36:02 +1100, Trev wrote: >> I just tried gitup and was told tha I had no permissions for=20 >> /var/db/gitup.=20 "sudo chown $USER /var/db/gitup" fixes that. >I just tried gitup and it was killed after apparently exhausting my=20 >swap space. I had no such problem with portsnap :-( gitup walks the destination tree (ie /usr/ports), hashing every file it finds (by reading the complete file into memory). Whilst the default gitup configuration ignores /usr/ports/packages and /usr/ports/distfiles, it reads and hashes all the files down both paths before ignoring them. One consequence is that gitup is unusable on small memory environments - in my case, I saw peak memory usage hit 5GB (though the largest file I have is 1.8GB, so I'm not sure why it's eating so much memory). >My system (Vultr VPS) has 512K memory and 1.5G swap. git is barely usable on such a system (it's peak memory usage is about 2GB whilst processing a ports tree). gitup is unusable unless you either delete all packages and distfiles, or symlink them out of the way. > > Can I not run gitup as a normal user? > >I don't believe so. Well, git or gitup need write access to the working directory and the associated metadata directory. --=20 Peter Jeremy --ebf+MdYvR7TaN1Li Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE7rKYbDBnHnTmXCJ+FqWXoOSiCzQFAmByUgpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEVF QjI5ODZDMzA2NzFFNzRFNjVDMjI3RTE2QTU5N0EwRTRBMjBCMzQACgkQFqWXoOSi CzRIwg//clZw+kSaTGobiXZqBCbL7jAb7pUV298tUbOW6Bw4Enbkpgn+bDHxPfw6 zYEhfSL/mHBoEUjLJ4bL+j4negl/rCnVAwI+TUNXmG+JWMswB8rrt8U+M9apwp0F hhkE0pyf3gLArf1qLM1n+pAAVpnTe+ij7mvnwSkUNkqXQbLtBjwM8PsXXUFPwJol tnwkrnBBjzxxDTOUdFhHkGOJibe6KdjJUTSpLrnIv/z54T/P6gVqvImSWLccUGoY k9lkTebt9LSElJ6/20oDNMTdyuZ78FPOJ2GqhtWEIu0GJhiNTHgFdtLmqJ//m8dj Ko0zo1S+r35o6GcLJLyg3CKtHsEw/Dps/YX5txF4Hjoj4IryxQsHGJ/c+jFl2k9o txTY/CZuvKk4J3inwnUWJx3dUxcp06cZQRfl+aYGOFKRlU2eRdmSRnKcH6v62+FZ /zx0zGP42TKYN/0vkuZkdLIQePcYDRPlmc7buawrBvu+mp8qcoR3q/MK5nmepQgv 7tRquwzMLEHmg1GSIXuiB+OqarS+MCuKYksEbCsethbEeSvh7zWWnB3qTe2Ady4g ct0hOF1q43yDzgd0b9KXnT55ppXUEQR86kWeCHBznwfb9Hk1T0YiP2Oe+OLXiSLM 0P7LLXTTWkoZeKcwAMBmTOJ0Xr/xjdiN6B+a/7qOV8+q70+ntCE= =BBbo -----END PGP SIGNATURE----- --ebf+MdYvR7TaN1Li--