Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 6 Oct 2008 09:23:37 +0400
From:      Eygene Ryabinkin <rea-fbsd@codelabs.ru>
To:        Miroslav Lachman <000.fbsd@quip.cz>
Cc:        freebsd-hackers@freebsd.org, bug-followup@freebsd.org, freebsd-ports@freebsd.org, portmgr@freebsd.org
Subject:   Re: ports/126853: ports-mgmt/portaudit: speed up audit of installed packages
Message-ID:  <fBWJkCKjscsePzEEmCUQJBXc15o@Vw/vnYB8jgSxjLDGajBSHdBTgp4>
In-Reply-To: <48E94281.8010300@quip.cz>
References:  <WGReTVL6CLts/44OKi4qLEsAGHs@jm/Q2DKg1djxmpGNf45V%2BWpjPIE> <48DE5CC0.9000708@localhost.inse.ru> <o/JeKQBFxyWYOEj%2BysAVRhQK6g8@iXA9ZWPrtc2I2BMzBXoToMd7YdQ> <48DF6735.4030906@quip.cz> <4bESZpNwE3z/DdlE2fwK/BXzQSo@2MQ0uKCiT7mdMUuLeUzs8Nv3ToQ> <xIGBGzzNkgJfXK2hY3ABIqS4mko@Nv45r0f9gWT8HCu35qu0Xm2Zg98> <48E94281.8010300@quip.cz>

next in thread | previous in thread | raw e-mail | index | archive | help

--+hZIELbchok2+JHy
Content-Type: text/plain; charset=koi8-r
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Miroslav, good day.

Mon, Oct 06, 2008 at 12:41:05AM +0200, Miroslav Lachman wrote:
> I am busy these days, but it is nice to read about your progress. I hope=
=20
> I will get some time to test all of these large patches in a few days=20
> and I will report back my experiences!

Fine, thank you!  I am re-CC'ing bug-followup@ to track this letter,
since it contains some useful information that should go into GNATS.

> One note before tests... do -n flag always download new INDEX file, or=20
> is it possible to use one already existing in /usr/ports?

Currently, it is downloads bzipped INDEX file to /var/db/portaudit every
time, but it uses mirror mode, so if remote file hadn't changed at all,
all network expences are just the HTTP's HEAD request and reply.

I can add another variable to the portaudit to force the usage of the
existing INDEX file, if it is needed.  By the way, how are you keeping
your INDEX file up to date (your proposed usage of 'pkg_version -I'
implies that you're always rely on it)?  I am just curious -- my INDEX
files are almost always stay unupdated, even if I am using portupgrade.

And there can be another way if one keeps ports tree updated: utility
can use 'make' to determine the version that is currently available on
the examined host.

But downloading the INDEX file from the central server seemed to be the
best way, since it almost always gives one the latest port versions, so
I had implemented this in a first place.

Don't know, however, how the badly the load to the central HTTP server
will be raised.  I am using just two first fields from the INDEX file,
so I can use such a stripped file.  For me, the reduction was about
6x: SIZE(INDEX-7.bz2) =3D 1126189, SIZE(INDEX-7.stripped.bz2) =3D 184345.

I am CC'ing the portmgr team.  Guys, could you quickly glance over these
patches and determine if they are useful to the project in large?  If
yes, then may be such a stripped INDEX can be created on the FreeBSD
servers (via cut -f1-2 -d'|' INDEX-N)?

Thanks!
--=20
Eygene
 _                ___       _.--.   #
 \`.|\..----...-'`   `-._.-'_.-'`   #  Remember that it is hard
 /  ' `         ,       __.--'      #  to read the on-line manual  =20
 )/' _/     \   `-_,   /            #  while single-stepping the kernel.
 `-'" `"\_  ,_.-;_.-\_ ',  fsc/as   #
     _.-'_./   {_.'   ; /           #    -- FreeBSD Developers handbook=20
    {_.-``-'         {_/            #

--+hZIELbchok2+JHy
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.9 (FreeBSD)

iEYEARECAAYFAkjpoNkACgkQthUKNsbL7YhirACeIewIwCM0wr/UBHnMp7hieJya
eUoAoIAwCdHLh38sZwl+bvw65cB9OvgW
=ANyt
-----END PGP SIGNATURE-----

--+hZIELbchok2+JHy--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?fBWJkCKjscsePzEEmCUQJBXc15o>