From owner-freebsd-current@FreeBSD.ORG Thu Jul 24 18:44:51 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5A0A8362 for ; Thu, 24 Jul 2014 18:44:51 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 3131A2A14 for ; Thu, 24 Jul 2014 18:44:51 +0000 (UTC) Received: from [192.168.1.2] (senat1-01.HML3.ScaleEngine.net [209.51.186.5]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 3F6B92C706 for ; Thu, 24 Jul 2014 18:44:50 +0000 (UTC) Message-ID: <53D15438.6040105@freebsd.org> Date: Thu, 24 Jul 2014 14:45:12 -0400 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: freebsd-current@freebsd.org Subject: Re: zfs send/recv: STILL invalid Backup Stream References: <62315eb454a95db636b7764aad3c0f9b@thebighonker.lerctr.org> <53D1448C.40908@freebsd.org> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6mtk50ScExqxoOGmKbKvkRr531j6j2waI" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Jul 2014 18:44:51 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --6mtk50ScExqxoOGmKbKvkRr531j6j2waI Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 2014-07-24 14:25, Larry Rosenman wrote: > On 2014-07-24 12:43, Larry Rosenman wrote: >> On 2014-07-24 12:38, Allan Jude wrote: >>> On 2014-07-24 13:33, Larry Rosenman wrote: >>>> TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT >>>> system, and receive the non-descript >>>> "invalid backup stream". >>>> >>>> borg.lerctr.org /home/ler $ sudo bin/backup-TBH-ZFS-initial.sh >>>> Password: >>>> receiving full stream of zroot@2014-07-24 into >>>> zroot/backups/TBH@2014-07-24 >>>> received 41.7KB stream in 300 seconds (142B/sec) >>>> receiving full stream of zroot/usr@2014-07-24 into >>>> zroot/backups/TBH/usr@2014-07-24 >>>> received 41.7KB stream in 1 seconds (41.7KB/sec) >>>> receiving full stream of zroot/usr/local@2014-07-24 into >>>> zroot/backups/TBH/usr/local@2014-07-24 >>>> received 2.81GB stream in 1116 seconds (2.58MB/sec) >>>> receiving full stream of zroot/usr/src@2014-07-24 into >>>> zroot/backups/TBH/usr/src@2014-07-24 >>>> cannot receive new filesystem stream: invalid backup stream >>>> borg.lerctr.org /home/ler $ cat bin/backup-TBH-ZFS-initial.sh >>>> #!/bin/sh >>>> DATE=3D`date "+%Y-%m-%d"` >>>> #DATE2=3D2013-03-24 >>>> #DATE2=3D`date -v "-1d" "+%Y-%m-%d"` >>>> # snap the source >>>> ssh root@tbh.lerctr.org zfs snapshot -r zroot@${DATE} >>>> # zfs copy the source to here. >>>> ssh root@tbh.lerctr.org "zfs send -R -D zroot@${DATE} | \ >>>> ssh home.lerctr.org \"zfs recv -F -u -v -d zroot/backups/TBH\""= >>>> # make sure we NEVER allow the backup stuff to automount. >>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \ >>>> awk '{printf "/sbin/zfs set canmount=3Dnoauto %s\n",$1}' | sh >>>> borg.lerctr.org /home/ler $ >>>> >>>> This has been happening for YEARS and I can't seem to interest >>>> anyone in >>>> fixing it. >>>> >>>> How can we get to the bottom of this? >>>> >>>> borg.lerctr.org /home/ler $ uname -a >>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #56 r26898= 2M: >>>> Tue Jul 22 10:14:59 CDT 2014 >>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64 >>>> borg.lerctr.org /home/ler $ ssh tbh uname -a >>>> FreeBSD thebighonker.lerctr.org 10.0-STABLE FreeBSD 10.0-STABLE #39 >>>> r269019M: Wed Jul 23 11:44:35 CDT 2014 >>>> root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/GENERIC amd64 >>>> borg.lerctr.org /home/ler $ >>>> >>> >>> Try adding -v to the 'zfs send' and see if it gives you more detail. >>> >>> Can you also try this script for the replication: >>> >>> http://github.com/allanjude/zxfer >> I've done that in the past and nothing, but I will try again. >> >> I will also look at zxfer.... :) >=20 >=20 > with the -v, no more info, just what looks like normal messages.... >=20 > 13:23:55 3.68G zroot/usr/src@2014-07-24 > 13:23:56 3.68G zroot/usr/src@2014-07-24 > 13:23:57 3.68G zroot/usr/src@2014-07-24 > 13:23:58 3.68G zroot/usr/src@2014-07-24 > 13:23:59 3.68G zroot/usr/src@2014-07-24 > 13:24:00 3.69G zroot/usr/src@2014-07-24 > 13:24:01 3.69G zroot/usr/src@2014-07-24 > 13:24:02 3.69G zroot/usr/src@2014-07-24 > 13:24:03 3.69G zroot/usr/src@2014-07-24 > 13:24:04 3.69G zroot/usr/src@2014-07-24 > 13:24:05 3.70G zroot/usr/src@2014-07-24 > 13:24:06 3.70G zroot/usr/src@2014-07-24 > 13:24:07 3.70G zroot/usr/src@2014-07-24 > 13:24:08 3.70G zroot/usr/src@2014-07-24 > 13:24:09 3.70G zroot/usr/src@2014-07-24 > 13:24:10 3.71G zroot/usr/src@2014-07-24 > 13:24:11 3.71G zroot/usr/src@2014-07-24 > cannot receive new filesystem stream: invalid backup stream > borg.lerctr.org /home/ler/bin $ I notice you are doing a deduplicated stream. Does it work without deduplication (zfs send -D)? --=20 Allan Jude --6mtk50ScExqxoOGmKbKvkRr531j6j2waI Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJT0VQ7AAoJEJrBFpNRJZKfiZkQAKJtwU+05G2nlINbejwhsS5y upu1ewh/dumEjv+Sa06o2N6QwYE2pcNZGqewgZ5ZA2NOyS4Pr14NEVBkJzbzcqai 1F/EhAOyFb0fCo1k9qwua1E3JOs9fuJD/CdAc/1dR50/fUbgZ53y5pyGlytJHgkC 5HXzKHbh2zjIzYji6B4HbhxWmCeaM7Nd12s1SItegKQkpLYYCuJ9g30v0F5pd8mb Sz4MyrGBjKET8eBIq4KaDqhAl2c26eNo3N0AhcO54EjoBDYbN4NkZiIQsNB5xMbn zyok1EhguNdLl6zM1EN+1FWlcscTozQFuMd0vEbNmSE2xYa2s9Q6PjpWUI3Jlv6T oF3a1uS/s5bQjczgCHjVVodnJ27BNZsM9Pi1QLFGlyKQ9TT7WNiUKo3dWjj5A1rd sJiyGL7NN6Tc7V2dIeAasLJxhK90OgWZHVUz1d/ZF9QaKmll/btz921Iqu5eJ7nW gew+REhpMZqt4T+fJKZzXW4/XfUh3py4cnxvZlTUF0937aU+ZFaMsCdj++JDlCK4 /FPODb71PVl24LKuqnlBLg7ZWRllWJ93jqdPEEZVGx5DkW47LPuvpdqmzFqLKNy/ od43BrohJQwVnxjClq13efP9J5VmK50ECa4ongCDm4GsZJlCQK9Ogqp53l2vMFWm 3Z6+naQj+I+KAN+PrjsB =8cjN -----END PGP SIGNATURE----- --6mtk50ScExqxoOGmKbKvkRr531j6j2waI--