Date: Sat, 18 Feb 2017 04:31:42 +0100 From: Sydney Meyer <meyer.sydney@googlemail.com> To: freebsd-net@freebsd.org Subject: Re: Slow Download Speeds from AWS S3 Message-ID: <DE9B0F39-A8AD-4DEF-8296-62F37DA27CF0@googlemail.com> In-Reply-To: <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk> References: <A6482775-D7F8-4FB8-9423-257D6D625D01@googlemail.com> <18e49da9-47eb-1803-e223-b4385e7d8690@multiplay.co.uk> <30F9FC69-CEBE-4CBE-93A9-DEDBD053C6C6@googlemail.com> <77fc04b6-380e-8826-3e43-5d820840e26c@multiplay.co.uk>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi Steve, sure, but i have deleted the bucket already.. i'll set a new one up = quickly.. do you have a specific aws region which you prefer? Sydney > On 18 Feb 2017, at 04:26, Steven Hartland <killing@multiplay.co.uk> = wrote: >=20 > Hey Sydney, I've had some feedback from other team members and armed = with this info I'm having a crack at enabling receive buffer = auto-scaling using RTT estimations when timestamps aren't available. >=20 > I don't have any S3 buckets to tests with so Is there any chance you = pop up your test file again for me? >=20 > Regards > Steve >=20 > On 16/02/2017 16:55, Sydney Meyer via freebsd-net wrote: >> Hi Steve, >>=20 >> increasing the buffer size did indeed enhance throughput. >>=20 >> I am obviously not an expert in this field, but i don't understand = why or if the TCP Receive Window Size shouldn't increase automatically. >>=20 >> I found this thread on the ML and i'm reading myself a bit more into = the topic right now. >>=20 >> = https://lists.freebsd.org/pipermail/freebsd-net/2014-August/039495.html >>=20 >> Thank you for your tip, however.. >>=20 >> Sydney >>=20 >>> On 16 Feb 2017, at 16:35, Steven Hartland <killing@multiplay.co.uk> = wrote: >>>=20 >>> Window scaling and receive buffer scaling is the most likely cause. >>>=20 >>> Check what the sysctl net.inet.tcp.recvspace is set to, then try = increasing it e.g. >>> sysctl net.inet.tcp.recvspace=3D655360 >>>=20 >>> This jumped the transfer rate with a wget and your test URL from = 3MB/s to 30MB/s here. >>>=20 >>> Regards >>> Steve >>>=20 >>> On 16/02/2017 14:34, Sydney Meyer via freebsd-net wrote: >>>> Hello, >>>>=20 >>>> I'm seeing continuous slow download speeds from Amazon S3, but only = on FreeBSD. Other OSes saturate the connection without problems. >>>>=20 >>>> This happens with 10.3-RELEASE and 11.0-RELEASE and only with AWS = S3 in different regions (Ireland, London, Frankfurt, US Standard have = been tested) whilst using fetch, curl, et. al. >>>>=20 >>>> I have tested this on multiple machines, bare metal, bhyve, Xen and = VMware VMs, routed setups and direct pppoe links.. all the same. >>>>=20 >>>> Anyone seeing similar issues? >>>>=20 >>>> Here's a url to try: >>>>=20 >>>> = http://s3.eu-central-1.amazonaws.com/4f48caf1d8bcbef8/c5b38f8b3625d2b6/zer= ofile.raw >>>>=20 >>>> Also, when doing double NAT, i.e. VMware Fusion FreeBSD Guest with = "Share with my Mac"-Interface, the machine is doing completely fine, as = in saturates the link, 90Mbps otherwise between 12-15Mbps.. >>>>=20 >>>> I also switched the FreeBSD Routers with Linux-based ones and with = the isp-provided router box, with the same result. >>>>=20 >>>> I have launched VMs with Digital Ocean to "rule out" my ISP and = there seems to be the same issue. Downloading from S3 is multiple times = slower than any other connection to services outside of S3 or on any = other OS. >>>>=20 >>>> It seems like other people are seeing the same issue: >>>>=20 >>>> https://forums.freebsd.org/threads/59756/#post-343064 >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?DE9B0F39-A8AD-4DEF-8296-62F37DA27CF0>