Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 3 May 2007 07:10:37 -0500
From:      David Kelly <dkelly@HiWAAY.net>
To:        David Banning <david+dated+1178599299.38573d@skytracker.ca>
Cc:        questions@freebsd.org
Subject:   Re: can't zip large files 2gb >
Message-ID:  <25CFA57D-585A-43F1-A5EF-9A1F82BE0A16@hiwaay.net>
In-Reply-To: <20070503044136.GA57871@skytracker.ca>
References:  <20070501195825.GA10269@skytracker.ca> <20070502093757.GA2835@kobe.laptop> <20070502162657.GA21779@skytracker.ca> <20070502171723.GA1615@kobe.laptop> <20070502180815.GA50145@skytracker.ca> <20070502190950.GA84501@Grumpy.DynDNS.org> <20070503044136.GA57871@skytracker.ca>

next in thread | previous in thread | raw e-mail | index | archive | help

On May 2, 2007, at 11:41 PM, David Banning wrote:

>> I haven't been paying 100% attention. Just how does it fail? What  
>> do you
>> mean by "corrupt"?
>>
>> Does the process run to completion?
>
> All programs zip with no errors. On reading;
>
> root# bzip2 -t zippedfile.bz2
> bzip2: 3s1.com-smartstage_ftp-full-20070502-0125AM.1b.tar.bz2:
> data integrity (CRC) error in data

Can't keep from thinking somehow your hardware is broken because  
myself and others have been gzip, bzip, zipping, large files for a  
long time under FreeBSD without problems. BUT on 6.0 I had  
intermittent problems trying to download files over 4 GB with  
FreeBSD. But seemingly only with "old" files, more than a day old.

A workaround was to cat file > /dev/null from a shell login about the  
same time as I started the ftp download. This clue helped eventually  
find the real problem in the FreeBSD kernel.

Just for kicks, try "cat file > /dev/null" while the compression  
process is running on same file. This might help keep your source  
file in cache while the compression process runs.

Apparently you have a spare original copy of the data laying around  
but another thing to try is "gzip -c file > file.gz" which does not  
destroy the original.

--
David Kelly N4HHE, dkelly@HiWAAY.net
========================================================================
Whom computers would destroy, they must first drive mad.




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?25CFA57D-585A-43F1-A5EF-9A1F82BE0A16>