From owner-freebsd-hubs@FreeBSD.ORG Sun Jan 13 09:43:17 2013 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 00A4716F for ; Sun, 13 Jan 2013 09:43:16 +0000 (UTC) (envelope-from simon@qxnitro.org) Received: from mail-lb0-f179.google.com (mail-lb0-f179.google.com [209.85.217.179]) by mx1.freebsd.org (Postfix) with ESMTP id 82053DEE for ; Sun, 13 Jan 2013 09:43:16 +0000 (UTC) Received: by mail-lb0-f179.google.com with SMTP id gm13so2221593lbb.24 for ; Sun, 13 Jan 2013 01:43:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qxnitro.org; s=google; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=aijypcjs0OcKbL3jas5KWWwZOoqDDun31ZSVR/96O/c=; b=qH+l4QeROygkOstTHiQ+7qVH7Yt+8JtDrIZEygCEncRbdp2Qo3nyKfOvpx0Y7rrb5w yeStuC0n0kz9Qh5QD4Ry/JXssKfrUxPdn4hzxh0t2ZgS/Y/VCbaimayjNTMdVXqY+wuq YULfctT0rdaMoYe77zb+j/GPdny/p50JL7ehE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:cc:content-type:x-gm-message-state; bh=aijypcjs0OcKbL3jas5KWWwZOoqDDun31ZSVR/96O/c=; b=Kavbf68bCs6fPqp7UuB1Ape2/J/QneuO8yts0cS7NMVoEDjLJMTgptmExIBUYs2o6f 7GB3I7kHRYjEI+Vw12xns2BBpYUzlH7eGk7t0Otf4tlOuPFuZMhOlo6SdzGHHfY3Piq7 I/M/3oDOsGL7HB3Re7uEbCYTCKlJstklD00tMWQ4OEJANyy/GWdBI7cprqnDbYcaNPSA PTfW0981yaWmirJ06LJTbgLPpzDjddZyrL25FogvnLmp/WbWxNaciO92GOxKbO0/vl9b /87x7NbNWOwy7CaID5PmbSHIiqBWJ5oF3SFVG9yDdtFbrBgMCqUM7Zct7CgcX9YeMefU YVmA== MIME-Version: 1.0 Received: by 10.152.147.103 with SMTP id tj7mr79330285lab.54.1358070194929; Sun, 13 Jan 2013 01:43:14 -0800 (PST) Received: by 10.112.19.41 with HTTP; Sun, 13 Jan 2013 01:43:14 -0800 (PST) X-Originating-IP: [89.100.233.26] In-Reply-To: <50F1411C.7070800@riverwillow.com.au> References: <50F1411C.7070800@riverwillow.com.au> Date: Sun, 13 Jan 2013 09:43:14 +0000 Message-ID: Subject: Re: cvsup-master choking? From: "Simon L. B. Nielsen" To: John Marshall Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQkZo0svbJ99g+w3Lr/3xaJPICkmKaWnRZnf8UAH3OpbuKTN6DUfghk6a3vq3A7u87uGPrSI Cc: freebsd-hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Jan 2013 09:43:17 -0000 On 12 January 2013 10:55, John Marshall wrote: > cvsup.au has not been able to update from cvsup-master for the past 12 > hours. Has there been an accidental config change or is there something > bad happening over on that side of the planet? To follow up on this since it's still ongoing. The server running cvsup-master is bit-master which also runs svn0.us-west, bit0.us-west. It should be plenty powerful to take this load, but as mentioned yesterday we ran into some nullfs issues which are being looked at. To avoid totally killing the server until we have fixed the problem the number of simultaneous clients on cvsup-master is decreased some. As the server is currently a lot happier the problem should be reduces as each sync will be a lot faster. PS. there are some mirrors which update very frequently but a broken and keep trying to download everything causing extra load. We will likely remove access to those sites (their mirrors have been broken for a month anyway) to reduce load. -- Simon L. B. Nielsen From owner-freebsd-hubs@FreeBSD.ORG Mon Jan 14 04:39:22 2013 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 178DCCD9; Mon, 14 Jan 2013 04:39:22 +0000 (UTC) (envelope-from john.marshall@riverwillow.com.au) Received: from mail4.riverwillow.net.au (mail4.riverwillow.net.au [202.125.45.59]) by mx1.freebsd.org (Postfix) with ESMTP id A0E77127; Mon, 14 Jan 2013 04:39:21 +0000 (UTC) Received: from [172.25.24.201] (riverw1.lnk.telstra.net [165.228.239.138]) (authenticated bits=0) by mail4.riverwillow.net.au (8.14.6/8.14.6) with ESMTP id r0E4d7SW066059 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NOT); Mon, 14 Jan 2013 14:39:09 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=riverwillow.com.au; s=m4001; t=1358138349; bh=OKBneo3fmGcr3yxCI4wAVHyhWEPUM6plAK4DTe3Rxng=; h=Date:From:To:CC:Subject:References:In-Reply-To; b=TyB07CDPi6Rxxs2HGgCY8wDtmujJfx0UolQKUzO5ylkkbOZXWJ+JbbtLdTG1l7LQT KJKVrKw/kgxoX/rK//W0aebLFsw7CWOjnZoR5j3kouhpjAfSczcFFbNEDvpxF8WAqN zFs+cF/TdwzMiSUABFGdUwk2Xw2b4GOYTn379ABc= Message-ID: <50F38BE1.6030202@riverwillow.com.au> Date: Mon, 14 Jan 2013 15:38:57 +1100 From: John Marshall Organization: Riverwillow Pty Ltd User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:17.0) Gecko/20130112 Thunderbird/17.0.2 MIME-Version: 1.0 To: "Simon L. B. Nielsen" Subject: Re: SLOW rsync from bit0.us-west References: <50F0F2CE.9050605@riverwillow.com.au> In-Reply-To: X-Enigmail-Version: 1.4.6 OpenPGP: id=A29A84A2; url=http://pki.riverwillow.com.au/pgp/johnmarshall.asc Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigE463FB4292E975A905AB145D" Cc: freebsd-hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jan 2013 04:39:22 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigE463FB4292E975A905AB145D Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable On 13/01/2013 06:58, Simon L. B. Nielsen wrote: > On 12 January 2013 15:37, Simon L. B. Nielsen wrote= : >> The server which runs bit0.us-west (which is also svn0.us-west), is >> totally bogged down. > Please have another look and see if things aren't better now. Thank you. Yes, a 12s synch. is a huge improvement. --=20 John Marshall --------------enigE463FB4292E975A905AB145D Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDzi+sACgkQw/tAaKKahKJEAQCfQqbbdYhim9sfDWhhWUl78zg/ B6AAoMKllu3ooJ979jCIMV3sLAanF4DC =uPO4 -----END PGP SIGNATURE----- --------------enigE463FB4292E975A905AB145D-- From owner-freebsd-hubs@FreeBSD.ORG Mon Jan 14 07:45:02 2013 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 349F55F2 for ; Mon, 14 Jan 2013 07:45:02 +0000 (UTC) (envelope-from john.marshall@riverwillow.com.au) Received: from mail4.riverwillow.net.au (mail4.riverwillow.net.au [202.125.45.59]) by mx1.freebsd.org (Postfix) with ESMTP id A733FA24 for ; Mon, 14 Jan 2013 07:45:01 +0000 (UTC) Received: from [172.25.24.201] (riverw1.lnk.telstra.net [165.228.239.138]) (authenticated bits=0) by mail4.riverwillow.net.au (8.14.6/8.14.6) with ESMTP id r0E7ilmP010040 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NOT); Mon, 14 Jan 2013 17:44:48 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=riverwillow.com.au; s=m4001; t=1358149488; bh=kf5RTq6cn/Czkcz9BfXnCAr2RGBGTuAfS20o8MX+I8w=; h=Date:From:To:CC:Subject:References:In-Reply-To; b=EkDaw1UnG6yIncvWvewiIL+4hfNZ2ua0w9VAEpRdrkK6D5FCeOQzEtIim5dHvtH7G LJLDa3vhNNxetfqvYNuMVL1iCxwIsT05IKWqyrYlRPtsHXchOiNI0Nk5xSqhjPHnp0 yVSmcnQPBJStsRx72D8rTxLvg695uGK3AiJCPPbE= Message-ID: <50F3B765.1000404@riverwillow.com.au> Date: Mon, 14 Jan 2013 18:44:37 +1100 From: John Marshall Organization: Riverwillow Pty Ltd User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:17.0) Gecko/20130112 Thunderbird/17.0.2 MIME-Version: 1.0 To: "Simon L. B. Nielsen" Subject: Re: cvsup-master choking? References: <50F1411C.7070800@riverwillow.com.au> In-Reply-To: X-Enigmail-Version: 1.4.6 OpenPGP: id=A29A84A2; url=http://pki.riverwillow.com.au/pgp/johnmarshall.asc Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig01B3C29BFC92ECB26F3A7B15" Cc: freebsd-hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jan 2013 07:45:02 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig01B3C29BFC92ECB26F3A7B15 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable On 13/01/2013 20:43, Simon L. B. Nielsen wrote: > The server running cvsup-master is bit-master which also runs > svn0.us-west, bit0.us-west. It should be plenty powerful to take this > load, but as mentioned yesterday we ran into some nullfs issues which > are being looked at. To avoid totally killing the server until we have > fixed the problem the number of simultaneous clients on cvsup-master > is decreased some. For some generous definition of 'some'? :-) We were rejected for all but two of our hourly updates over the past 48 hours. I wouldn't have picked hh:18 as being such a popular slot! I just went and banged on almost every minute and found only two that 'worked', and one of those that 'worked' two hours in a row. I've changed our cvsupin crontab to use that minute instead. > As the server is currently a lot happier the problem should be reduces > as each sync will be a lot faster. and the CVSup access limits will become more generous? > PS. there are some mirrors which update very frequently but a broken > and keep trying to download everything causing extra load. We will > likely remove access to those sites (their mirrors have been broken > for a month anyway) to reduce load. Good thinking. Perhaps you may consider announcing the broken mirrors on this list as well? --=20 John Marshall --------------enig01B3C29BFC92ECB26F3A7B15 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDzt24ACgkQw/tAaKKahKK7xQCdHsP1uNjVWetEpx10+wrn17QR LLYAoIBf0/2Legr3GTigzZuOtisQNlBt =coFC -----END PGP SIGNATURE----- --------------enig01B3C29BFC92ECB26F3A7B15--