Date: Fri, 11 Jan 2013 23:30:21 -0600 From: Stephen Montgomery-Smith <stephen@missouri.edu> To: freebsd-hubs@freebsd.org Subject: Re: SLOW rsync from bit0.us-west Message-ID: <50F0F4ED.4020203@missouri.edu> In-Reply-To: <50F0F2CE.9050605@riverwillow.com.au> References: <50F0F2CE.9050605@riverwillow.com.au>
next in thread | previous in thread | raw e-mail | index | archive | help
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 01/11/2013 11:21 PM, John Marshall wrote: > I have been updating the gnats collection on our mirror via rsync > since the CVSup updates stopped but noticed this morning that the > updates appeared to be stalled. I killed off jobs that appeared to > be stuck downloading incremental file list (after about 20 minutes) > but then thought to run rsync manually with -vvv. What I saw then > was short bursts of messages like 'recv_file_name(bin/nnnn)' > interspersed with 15-20 seconds of nothing. tcpdump showed just a > handful of packets every 15 seconds or so. The update eventually > finished after more than 2 hours. > > I ran the rsync again after about 10 minutes with only a single -v > and included --stats in the command line. This time it took only 1 > hour to update 9 files and produced the following output. > > ozsrv03# rsync -avz --stats > bit0.us-west.freebsd.org::FreeBSD-bit/gnats/ > /freebsd/current/gnats/gnats This is bit0.us-west.FreeBSD.org. > > receiving incremental file list bin/ bin/175214 docs/ docs/175224 > gnats-adm/ gnats-adm/current gnats-adm/index gnats-adm/locks/ > kern/ kern/151564 kern/152250 kern/153361 ports/175221 > ports/175222 > > Number of files: 174424 Number of files transferred: 9 Total file > size: 1738253321 bytes Total transferred file size: 33819340 bytes > Literal data: 70300 bytes Matched data: 33749040 bytes File list > size: 1967813 File list generation time: 0.075 seconds File list > transfer time: 0.000 seconds Total bytes sent: 41303 Total bytes > received: 1989084 > > sent 41303 bytes received 1989084 bytes 612.76 bytes/sec total > size is 1738253321 speedup is 856.12 > > The network isn't any worse than usual. We have a 100Mbps > connection and latency across the Pacific Ocean from Australia is > normal (~170ms RTT). > > ozsrv03# ping -qc 3 bit0.us-west.FreeBSD.org. PING > bit0.ysv.FreeBSD.org (8.8.178.111): 56 data bytes > > --- bit0.ysv.FreeBSD.org ping statistics --- 3 packets transmitted, > 3 packets received, 0.0% packet loss round-trip min/avg/max/stddev > = 168.805/168.922/169.023/0.090 ms > > Is it just me? > I was doing csup from cvsup-master this morning, and it was similarly extremely slow. I killed it, and then tried again several hours later, and it went at normal speed. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJQ8PToAAoJEC3xK9GaktgHotIH/2Vwr4vq5BNJ8fy1dmgAzGvi 2vSzvzYz8A2sl0yErQudEkdO9aBxps2D+I+fpI3Ob6mSlij839gq3cmGndtefNYA h8psA8TrJnh3W1VlaBEIC9NZkJooKSWq3A4NboMuYH2ReNcQeXZUZn7iL4WG8STo j+SyRHYo7SJ8DEeXtsSeTiOP6ltPcNU+fbIgpqFtGd4AA3Yd6fCWbdEpnp/nPf8a lRY+3eWPO3X0ujomRW8eO1dSlffz62eIC+NVzCPeqHkodFRHQ+Kp2AFFTvUBsUSj iaQ66MzA911Rl/bW0ZaAXkf+br2VjGVPR84urAr5hMCCNxKW79nHK+UEMlQDbTk= =PlQC -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?50F0F4ED.4020203>