Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 3 May 2007 07:10:37 -0500
From:      David Kelly <>
To:        David Banning <>
Subject:   Re: can't zip large files 2gb >
Message-ID:  <>
In-Reply-To: <>
References:  <> <20070502093757.GA2835@kobe.laptop> <> <20070502171723.GA1615@kobe.laptop> <> <> <>

Next in thread | Previous in thread | Raw E-Mail | Index | Archive | Help

On May 2, 2007, at 11:41 PM, David Banning wrote:

>> I haven't been paying 100% attention. Just how does it fail? What  
>> do you
>> mean by "corrupt"?
>> Does the process run to completion?
> All programs zip with no errors. On reading;
> root# bzip2 -t zippedfile.bz2
> bzip2:
> data integrity (CRC) error in data

Can't keep from thinking somehow your hardware is broken because  
myself and others have been gzip, bzip, zipping, large files for a  
long time under FreeBSD without problems. BUT on 6.0 I had  
intermittent problems trying to download files over 4 GB with  
FreeBSD. But seemingly only with "old" files, more than a day old.

A workaround was to cat file > /dev/null from a shell login about the  
same time as I started the ftp download. This clue helped eventually  
find the real problem in the FreeBSD kernel.

Just for kicks, try "cat file > /dev/null" while the compression  
process is running on same file. This might help keep your source  
file in cache while the compression process runs.

Apparently you have a spare original copy of the data laying around  
but another thing to try is "gzip -c file > file.gz" which does not  
destroy the original.

David Kelly N4HHE,
Whom computers would destroy, they must first drive mad.

Want to link to this message? Use this URL: <>