Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 27 Jun 2002 14:25:25 -0400
From:      Bill Moran <wmoran@potentialtech.com>
To:        Philip Hallstrom <philip@adhesivemedia.com>
Cc:        freebsd-questions@FreeBSD.ORG
Subject:   Re: FTP/HTTP caching proxy for use with fetch and ports?
Message-ID:  <3D1B5895.5020704@potentialtech.com>
References:  <20020627103338.C21360-100000@cypress.adhesivemedia.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Philip Hallstrom wrote:
> Hi all -
> 	I've got a small LAN (4 machines) and I tend to install a lot of
> the same ports on all the machines (usually using portupgrade).  What I've
> been doing up till now is installing on one machine and then ftp'ing the
> distfiles over to the other machines and installing on them.   I know I
> could build packages and do it that way, but for whatever reason I don't.
> 
> I started looking into caching proxies that would help automate this
> process somewhat, but I haven't had much luck.  I tried jftpgw (FTP only)
> but could never get it to work right.  Tried Apache's proxy which says it
> will do both, but it seemed to only cache HTTP and it's not really
> designed for "long term caching" so to speak.
> 
> Anyone have any suggestions?  Seems like this would be a common thing to
> reduce bandwidth...

In addition to the other suggestion (use NFS, which I have been doing with
great success) you can use squid, which will cache both FTP and HTTP.

Squid won't do what you want out of the box, however, and neither will
fetch.  Two things to do (in order)
1. Make sure fetch knows to use the proxy.  The man page tells you how to
    do this.  I believe you set an environ, but I'm not sure, read the man.
2. Make sure your proxy server will cache very large files.  Squid refuses
    to cache very large files by default, and I'd guess other proxy servers
    do the same.  Squid can be configured, however, to cache files no matter
    how large they are.  On the proxies I've installed, this tweak has
    been a good idea.  Just make sure you have enough disk space to cache
    all that stuff.

-- 
Bill Moran
Potential Technologies
http://www.potentialtech.com


To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3D1B5895.5020704>