From owner-freebsd-ports@FreeBSD.ORG  Fri May 23 10:46:51 2014
Return-Path: <owner-freebsd-ports@FreeBSD.ORG>
Delivered-To: freebsd-ports@FreeBSD.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 508F0FA6;
 Fri, 23 May 2014 10:46:51 +0000 (UTC)
Received: from mailout07.t-online.de (mailout07.t-online.de [194.25.134.83])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "mailout00.t-online.de",
 Issuer "TeleSec ServerPass DE-1" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id 146182CFE;
 Fri, 23 May 2014 10:46:50 +0000 (UTC)
Received: from fwd18.aul.t-online.de (fwd18.aul.t-online.de [172.20.26.244])
 by mailout07.t-online.de (Postfix) with SMTP id CE2865E7C31;
 Fri, 23 May 2014 12:38:17 +0200 (CEST)
Received: from [192.168.119.11]
 (bRr0qeZCYh7r2uw4i5oGwlZ7QX5khlT-3QptMhpsmLs8TQmggk-mJFfHy7hNER0ZDE@[84.154.114.101])
 by fwd18.t-online.de
 with esmtp id 1Wnmrg-1NV6ps0; Fri, 23 May 2014 12:38:16 +0200
Message-ID: <537F250E.2090403@freebsd.org>
Date: Fri, 23 May 2014 12:38:06 +0200
From: Stefan Esser <se@freebsd.org>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
To: ports FreeBSD <freebsd-ports@FreeBSD.org>
Subject: pkg-devel much slower than pkg?
X-Enigmail-Version: 1.6
Content-Type: text/plain; charset=ISO-8859-15
Content-Transfer-Encoding: 7bit
X-ID: bRr0qeZCYh7r2uw4i5oGwlZ7QX5khlT-3QptMhpsmLs8TQmggk-mJFfHy7hNER0ZDE
X-TOI-MSGID: 9ce7e10e-e95f-4a10-b627-59ac14976fbb
X-BeenThere: freebsd-ports@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: Porting software to FreeBSD <freebsd-ports.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-ports>,
 <mailto:freebsd-ports-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-ports/>
List-Post: <mailto:freebsd-ports@freebsd.org>
List-Help: <mailto:freebsd-ports-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-ports>,
 <mailto:freebsd-ports-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 23 May 2014 10:46:51 -0000

On my -CURRENT system with 1572 ports installed, I decided to give
pkg-devel (pkg-1.3.0.b2) a try.

Using portmaster, I observe very significant increases in the time
required to check which ports to upgrade. With pkg-devel:

# time portmaster -a
===>>> Gathering distinfo list for installed ports

===>>> Starting check of installed ports for available updates

===>>> All ports are up to date

===>>> Exiting

real    13m43.057s (= 823s)
user    0m44.465s
sys     1m20.432s

The same command with pkg-1.2.7 needs less than 20% of the real
time to run:

real    2m30.298s (= 150s)
user    0m39.246s
sys     1m11.392s

It may be too early to expect pkg-1.3 to be optimized for speed,
but I just wanted to report this regression ...

Since the CPU times are not so different, it appears that the amount
of disk I/O is much higher with pkg-devel.

It might be possible to optimize the database structure or to cache
larger parts of the package DB in RAM (size is some 100MB on my system).

Regards, STefan