From owner-freebsd-arch Wed Mar 14 14:57:38 2001 Delivered-To: freebsd-arch@freebsd.org Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by hub.freebsd.org (Postfix) with ESMTP id F141F37B718 for ; Wed, 14 Mar 2001 14:57:35 -0800 (PST) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.11.3/8.11.1) id f2EMvSh11825; Wed, 14 Mar 2001 16:57:28 -0600 (CST) (envelope-from dan) Date: Wed, 14 Mar 2001 16:57:27 -0600 From: Dan Nelson To: Nate Williams Cc: Dag-Erling Smorgrav , freebsd-arch@FreeBSD.ORG Subject: Re: [PATCH] add a SITE MD5 command to ftpd Message-ID: <20010314165727.A2240@dan.emsphone.com> References: <20010314105918.A5204@roaming.cacheboy.net> <35525.984597779@critter> <20010314210758.A2405@roaming.cacheboy.net> <15023.53743.215996.538067@nomad.yogotech.com> <20010314130025.A3031@dragon.nuxi.com> <20010314161646.A1482@dan.emsphone.com> <15023.61042.768406.854325@nomad.yogotech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.3.14i In-Reply-To: <15023.61042.768406.854325@nomad.yogotech.com>; from "Nate Williams" on Wed Mar 14 15:19:30 GMT 2001 X-OS: FreeBSD 5.0-CURRENT Sender: owner-freebsd-arch@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG In the last episode (Mar 14), Nate Williams said: > > Another thing to consider before adding SITE MD5 as a command is > > that it's an extremely slow operation. md5'ing a 10MB file takes > > about 1/3rd of a second on my pIII/600. It would take 5 minutes of > > CPU time to md5 1-gig worth of sources, and that's assuming that > > the FTP server is idle. ftpd would have to cache the md5 checksum > > somewhere for it to be acceptable, and then you've got the same > > caching problem (how does ftpd know when the file has changed to is > > can update its cached md5?). > > Is that cost greater than the cost of sending the data out over the > wire? Depends. Are we planning on only using the MD5 feature in Bill Fenner's port-checking scripts, or are we going to put it in bsd.port.mk? Do we want a thousand people doing "SITE MD5" commands every time a new copy of Netscape/Apache/kde/whatever comes out? You have to balance the cost of forcing an MD5 calc for every port fetch against the chance of a SIZE check returning a false-positive match. -- Dan Nelson dnelson@emsphone.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-arch" in the body of the message