Date: Thu, 24 Jul 2014 16:07:40 -0400 From: Allan Jude <allanjude@freebsd.org> To: freebsd-current@freebsd.org Subject: Re: zfs send/recv: STILL invalid Backup Stream Message-ID: <53D1678C.4000007@freebsd.org> In-Reply-To: <c93ef94a8e9e076b86a65f4986d0e30d@thebighonker.lerctr.org> References: <62315eb454a95db636b7764aad3c0f9b@thebighonker.lerctr.org> <53D1448C.40908@freebsd.org> <d0612ef9399b4e95bd09e5271c91505b@thebighonker.lerctr.org> <eefa10e173e2e23a88c85c38221a1c22@thebighonker.lerctr.org> <53D15438.6040105@freebsd.org> <0a9cd451c3b4304d2b9d899fcb3decc3@thebighonker.lerctr.org> <cc635a377e817cb57d27650ed3e558f4@thebighonker.lerctr.org> <3d2aac84d962a703fbf56a864ba5f19c@mailbox.ijs.si> <c93ef94a8e9e076b86a65f4986d0e30d@thebighonker.lerctr.org>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --e0Xlq1IfcbqKLu49LDATHoaS9adO8j7L3 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 2014-07-24 15:57, Larry Rosenman wrote: > On 2014-07-24 14:53, Mark Martinec wrote: >> 2014-07-24 21:31, Larry Rosenman wrote: >>> borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O >>> root@tbh.lerctr.org -R zroot zroot/backups/TBH >>> Creating recursive snapshot zroot@zxfer_26699_20140724135840. >>> Checking grandfather status of all snapshots marked for deletion... >>> Grandfather check passed. >>> Sending zroot@zxfer_26699_20140724135840 to zroot/backups/TBH/zroot. >>> Sending zroot/ROOT@zxfer_26699_20140724135840 to >>> zroot/backups/TBH/zroot/ROOT. >>> Sending zroot/ROOT/default@zxfer_23699_20140724134435 to >>> zroot/backups/TBH/zroot/ROOT/default. >>> Sending zroot/ROOT/default@zxfer_26699_20140724135840 to >>> zroot/backups/TBH/zroot/ROOT/default. >>> (incremental to zroot/ROOT/default@zxfer_23699_20140724134435.) >>> Sending zroot/home@zxfer_26699_20140724135840 to >>> zroot/backups/TBH/zroot/home. >> >>> Write failed: Cannot allocate memory >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >>> cannot receive new filesystem stream: invalid backup stream >>> Error when zfs send/receiving. >>> borg.lerctr.org /home/ler # >>> >>> well that's different....... >> >> Sounds familiar, check my posting of today and links therein: >> >> http://lists.freebsd.org/pipermail/freebsd-net/2014-July/039347.html= >> >> Mark > I'm not using netgraph to the best of my knowledge.... > and the only fails on the SENDING host are: > 8 Bucket: 64, 0, 41, 3555, 257774, 11, = 0 > 12 Bucket: 96, 0, 96, 2569, 123653, 0, = 0 > 16 Bucket: 128, 0, 17195, 506, 215573, 0, = 0 > 32 Bucket: 256, 0, 340, 4670, 900638, 50, = 0 > 64 Bucket: 512, 0, 10691, 365, 546888,185232, = 0 > 128 Bucket: 1024, 0, 3563, 905, 348419, 0, = 0 > 256 Bucket: 2048, 0, 2872, 162, 249995,59834, = 0 > vmem btag: 56, 0, 192811, 51500, 502264,1723, = 0 >=20 >=20 I regularly use zxfer to transfer 500+ GiB datasets over the internet. This week I actually replicated a 2.1 TiB dataset with zxfer without issu= e. I wonder which thing is running out of memory. Is there a delay while it is 'running out of memory', or does it fail immediately? Does running top while it is working on running out of memory reveal anything? I would expect to use up a lot of memory while doing deduplication, but not otherwise. Note: I most often use openssh-portable rather than base ssh for replication, as I enable the nonecipher to reduce CPU usage, and adjust the TcpRcvBuf upwards to actually saturate a gigabit over the internet. --=20 Allan Jude --e0Xlq1IfcbqKLu49LDATHoaS9adO8j7L3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJT0WePAAoJEJrBFpNRJZKfh/gQAIU1hqAVh+MNeGJcdGxOmX80 XAUom/xeG0VFHH5WGmMJa/wq2ouYg0jhTTZ5eOsK4ecnCQzRODGomBZd+OBXSThm KXsREXz2wgOWQV+kfjD38bE5mDUExyguFwRCn79RGNmeALCIDslRfQjMmuRLV4G/ VK74ykzSyIT0llEnKa/j/JFYaETGJONv4ouF3odBEPIrHQ3/TJ/wRqbrnPhs8ooO 1fJrZpUh4qeOmRdWbHeTg6MrI4HlKZV8JIP3S0+BLCFQu/a0nygfUw+XYAsUAala if/ByCnSaapoq3++MkcM/pTEbHrgpAeNJOD9lCvZVcnN5W0HE5jNz8vMazODiqXR pbQIf2lYJXfS1tZfigUDeyzYuB4kJcekn47lzCQ5L7dM+fx+rguitsOIkGRYdKf+ LrsMtjCcs3pIWYY7eA108IdOKC4P5PQ9kVLrXZZgYvcTWUNr9dqr4CovHCciXHM1 RLiTDk8bYMQYZiEDX7wJ9b72O7u/W/y72tVc17JMfkGgzkBV0UawsSbCAAx+KFWg SlM7jUe4WgSpvP7u+wMmVWqUi+aXiOhes6TvjLe8jXm/FTpCGhevxrGYmZ5SgQfy 2VAyNZYzgsPXBUHserbV8ASDW2tzAI82CPGsJsGmyqp89DXYv1lhHy2/fb2POLpA t2cBceh9/hQWJVbZBG/m =z/m5 -----END PGP SIGNATURE----- --e0Xlq1IfcbqKLu49LDATHoaS9adO8j7L3--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53D1678C.4000007>