From owner-freebsd-questions@FreeBSD.ORG Thu May 3 12:23:50 2007 Return-Path: X-Original-To: questions@freebsd.org Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B3CE16A400 for ; Thu, 3 May 2007 12:23:50 +0000 (UTC) (envelope-from dkelly@HiWAAY.net) Received: from bee.hiwaay.net (bee.hiwaay.net [216.180.54.11]) by mx1.freebsd.org (Postfix) with ESMTP id EFB7913C46C for ; Thu, 3 May 2007 12:23:49 +0000 (UTC) (envelope-from dkelly@HiWAAY.net) Received: from [10.0.0.2] ([216.186.148.249]) (authenticated bits=0) by bee.hiwaay.net (8.13.8/8.13.8) with ESMTP id l43CA7ul1390911 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NO); Thu, 3 May 2007 07:10:08 -0500 (CDT) In-Reply-To: <20070503044136.GA57871@skytracker.ca> References: <20070501195825.GA10269@skytracker.ca> <20070502093757.GA2835@kobe.laptop> <20070502162657.GA21779@skytracker.ca> <20070502171723.GA1615@kobe.laptop> <20070502180815.GA50145@skytracker.ca> <20070502190950.GA84501@Grumpy.DynDNS.org> <20070503044136.GA57871@skytracker.ca> Mime-Version: 1.0 (Apple Message framework v752.3) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <25CFA57D-585A-43F1-A5EF-9A1F82BE0A16@hiwaay.net> Content-Transfer-Encoding: 7bit From: David Kelly Date: Thu, 3 May 2007 07:10:37 -0500 To: David Banning X-Mailer: Apple Mail (2.752.3) Cc: questions@freebsd.org Subject: Re: can't zip large files 2gb > X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2007 12:23:50 -0000 On May 2, 2007, at 11:41 PM, David Banning wrote: >> I haven't been paying 100% attention. Just how does it fail? What >> do you >> mean by "corrupt"? >> >> Does the process run to completion? > > All programs zip with no errors. On reading; > > root# bzip2 -t zippedfile.bz2 > bzip2: 3s1.com-smartstage_ftp-full-20070502-0125AM.1b.tar.bz2: > data integrity (CRC) error in data Can't keep from thinking somehow your hardware is broken because myself and others have been gzip, bzip, zipping, large files for a long time under FreeBSD without problems. BUT on 6.0 I had intermittent problems trying to download files over 4 GB with FreeBSD. But seemingly only with "old" files, more than a day old. A workaround was to cat file > /dev/null from a shell login about the same time as I started the ftp download. This clue helped eventually find the real problem in the FreeBSD kernel. Just for kicks, try "cat file > /dev/null" while the compression process is running on same file. This might help keep your source file in cache while the compression process runs. Apparently you have a spare original copy of the data laying around but another thing to try is "gzip -c file > file.gz" which does not destroy the original. -- David Kelly N4HHE, dkelly@HiWAAY.net ======================================================================== Whom computers would destroy, they must first drive mad.