From owner-freebsd-questions@FreeBSD.ORG Sun Dec 21 21:02:18 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CB4EC1065747 for ; Sun, 21 Dec 2008 21:02:18 +0000 (UTC) (envelope-from wmoran@potentialtech.com) Received: from mail.potentialtech.com (internet.potentialtech.com [66.167.251.6]) by mx1.freebsd.org (Postfix) with ESMTP id 9F2D88FC16 for ; Sun, 21 Dec 2008 21:02:18 +0000 (UTC) (envelope-from wmoran@potentialtech.com) Received: from vanquish.ws.pitbpa0.priv.collaborativefusion.com (pr40.pitbpa0.pub.collaborativefusion.com [206.210.89.202]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.potentialtech.com (Postfix) with ESMTPSA id 7B29CEBC0A; Sun, 21 Dec 2008 16:02:16 -0500 (EST) Date: Sun, 21 Dec 2008 16:02:15 -0500 From: Bill Moran To: "Kelly Jones" Message-Id: <20081221160215.326d9c75.wmoran@potentialtech.com> In-Reply-To: <26face530812211223m118c8f11rbc16e1a69e01f582@mail.gmail.com> References: <26face530812211223m118c8f11rbc16e1a69e01f582@mail.gmail.com> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org Subject: Re: bzip2split X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Dec 2008 21:02:18 -0000 In response to "Kelly Jones" : > Can I split a large (4G+) bzip2 file into smaller bzip2 files? Notes: > > % Obviously, 'split' won't work for 2 reasons: > > % Each chunk won't have the BZIP2 header > > % 'split' will cut the file inside a bzip2 "block", rendering the > first/last blocks of each file unreadable. You can split it. You'll just have to rejoin it before you can uncompress it. Clever use of cat and pipes will do that without intermediate files. You could also split the file prior compression. Then you could uncompress each part separately, _then_ rejoin the parts. -- Bill Moran http://www.potentialtech.com