From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 11 16:35:31 2013 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id ABF026D9 for ; Thu, 11 Jul 2013 16:35:31 +0000 (UTC) (envelope-from dyokunev@ut.mephi.ru) Received: from mail.ut.mephi.ru (nexus.ut.mephi.ru [194.67.76.14]) by mx1.freebsd.org (Postfix) with ESMTP id 2C434191A for ; Thu, 11 Jul 2013 16:35:30 +0000 (UTC) Received: from [194.67.76.242] (unknown [194.67.76.242]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: dyokunev@ut.mephi.ru) by mail.ut.mephi.ru (Postfix) with ESMTPSA id 91E5E182AC07E; Thu, 11 Jul 2013 20:35:29 +0400 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ut.mephi.ru; s=default; t=1373560529; bh=noZlx7UNSTGeJpZMuuFy+dBadZaIP2gFx1eiOewUhBY=; h=Date:From:Reply-To:To:CC:Subject:From; b=vSCvZDoBvGGfRJK/e2W+/tDnhEe96U/7j/VH9vQnThdbGpKoxxHm5MYq+GcS94hha 7e242Uwlc9W6bNjTJUeE2pKQjW0Rh4MHlYxAeg0bHRVNUaL+fv6SCWORrqNKSO4ZT6 bJV0tsUGLhJF53k7sA8HeV+n/J0h01Iv0glPDpvlokD8ZCmnofOe/zORqsDfaODMAX 4Gk18bD2ynPZrER4/jc1puyjoYj71BkB1uYvYjqxOspVT7E2QkqGGSslH59qmoNj0v /mYinnXf4BXCgEs7OrgGVZXs02SgjsBz4Z2wzQQ7/ZtPXei8uFvaU6fsHteXtyb67N 8UYhsulzw8fWUlDJDJEADJ2miCHTV65jRETmFSe9HnWwg85SdF3NdxQuFNMKoxJ9NI u/uLAnL1NMwh87XLaqOBVlap2I2D2EKWj8vKdXDxpuf6evowjKZ/rWNaB6BPTVmEJ6 OsDsh/XKA86mNFf211celk2CD3QMd2IrpJAQw6ij4103aHca51DoSKamx0MNVemorz E+b2/gGyWMy2K+rUsiRl29Hvtvzn3aLwTL0IRU3rSXJtHXhZ8RSlf1xJWCqe+w+U1x RZrr6fM96axRydMU/j0KP5aVFMkN+puY2Ba3egGSlaVNddX3ZdJSTYI3gkxlM6nwh2 BW3TxcSvs2x98EjH1uRvqEiI= Message-ID: <51DEDEB9.1060804@ut.mephi.ru> Date: Thu, 11 Jul 2013 20:35:05 +0400 From: "Dmitry Yu Okunev (mirror.mephi.ru)" Organization: NRNU MEPhI User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130623 Thunderbird/17.0.7 MIME-Version: 1.0 To: freebsd-hubs@freebsd.org Subject: Setting up a mirror X-Enigmail-Version: 1.5.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="----enig2AXJDXPJRALRIPVWPCUWV" Cc: mirror@mephi.ru X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: mirror@mephi.ru List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2013 16:35:31 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2AXJDXPJRALRIPVWPCUWV Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello. We have a mirror "mirror.mephi.ru" (aka "ftp.ru.debian.org"). That's a server physically located in Moscow (Russia, RU) with 6TB disk space on RAID1 (12 TB of raw space) and with 2Gbps link to Internet. So, I'm currently trying to setup a full mirror of FreeBSD project. However, I was faced with some unclearness about CVSup. First of all, I didn't found any easy way to compile CVSup for Debian wheezy on amd64. Also, the CVSup is recommended in the handbook, however I've found file "ftp://ftp.freebsd.org/pub/FreeBSD/development/FreeBSD-CVS.README", where it's said, that CVS is deprecated and I should use SVN. I tried to follow a link on the page to sort out how to sync with SVN, but got error "Page not found" (http://www.freebsd.org/doc/handbook/mirrors-svn.html). Please, help me to sort out how should I setup the mirror. :) Is there any HOWTO for my case? --=20 Best regards, Dmitry, head of UNIX-tech department NRNU MEPhI, tel. 8 (495) 788-56-99, add. 8255 ------enig2AXJDXPJRALRIPVWPCUWV Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJR3t7OAAoJEK2K5AyOMGecpxoP+QG2GVlnLRbsANZn1q9cpBZE x7uQ7HuH+qtAhW0pBVzo9N8HKR9GK1oZ2Kp0G+/WFcg171MPjbUPJFcWO4zZ3fm6 2U09Ojp1zRi3dF2bqjVG4FilZBBz2+ltyzVAyjgiVB7tUxpyJVTgprfTQnj56SD9 jxsImOBrAD3pATiM+KZZc45gbIvgZ/IiAs1RVXZ8ja4Zl74ZvsgnPjTPsWHwDGgk +h3jC+2Rsi4zfGsHE19e/IK2Msq8GuuQoiB/4aNKw0nT9ixP4BtGFwB0bSbu98Ba AFD/d4z1aqcbtCqRA4aBNcERGPBBjQcFGpA+O40ofTpG5UPt/9st7VDvuBqlgGdZ 6W+0DewBwddy50/pF/piVVrGp+MTx9gexJmt9L1I6h2NwFUxtqbPU4lNgNKOZ07p deqSk3RNbV64LNw8aL0IxDqOf0/mu5P11ggI2h5JhL7YLnw0yMDpbCQfFvFO2ej0 aXBAYx6CEl2U1EKgcAxTPlbvis7ScfOgbH7hOlk6n9CbqrYCrM1yauG/EzM75FUY wMrjSQcyMwj3XvHL1vobtPdDSC8wmV5uvvcRAWrZrwCuPHba3ZrQwhTVWZ5fvsaE FoE3d5ljJ+CcGjE2EyAKm2M1ijnoc9kbBbj0JpE3Sz2hq5Yc1CJeHiNcWPjT13QX F9MDoPCdY1Je24w0+msq =G4sy -----END PGP SIGNATURE----- ------enig2AXJDXPJRALRIPVWPCUWV-- From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 11 21:04:00 2013 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 33EB473D for ; Thu, 11 Jul 2013 21:04:00 +0000 (UTC) (envelope-from peter@wemm.org) Received: from mail-vb0-x236.google.com (mail-vb0-x236.google.com [IPv6:2607:f8b0:400c:c02::236]) by mx1.freebsd.org (Postfix) with ESMTP id E8F5C15FD for ; Thu, 11 Jul 2013 21:03:59 +0000 (UTC) Received: by mail-vb0-f54.google.com with SMTP id q12so960401vbe.41 for ; Thu, 11 Jul 2013 14:03:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wemm.org; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=v2VJkle+q2v8K2BU5GA4i8wkwQPzxi4ibuQUavmCxS0=; b=gT/ErCpjIIPoZ5HCtTjZlMiKjthdlXVIb49kPLevP33RBK7ztFcqwgZACqJztvYNSr 6T+egsZoUK5ZoVPg+1eE25AVA15zsAtCi9j69lbFI2e0HXlZJUSQIc5hl55TETxvahYn joq17AiT1TWdoscGzpFqRhkjKrG9m0eHFIj7I= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=v2VJkle+q2v8K2BU5GA4i8wkwQPzxi4ibuQUavmCxS0=; b=Cp1pEm/ldu+mlQtbPKRD8cMJT/AiXI5wfsnCvWhnUg8UF9jHAgvruFGx52IYdUCq+t ONrOIT+cMELSeGXrmbQcwt9juL/NFrYFC/PyWN8ppySIe6d2trSDFeOLr1r2G7vBs96O K12n2qNb5JTDZMzBqxRZZqEpPnzJCxt893zHTjs0ma9QZJLSTPosnKNM1Ggr1ZDL7+zq HbdySNHitxcDFvx/LrLTnqRevL5G4yUZvPfI9BgYcbeDL67umUbml3SLER1LYaDnb/8Z zgduNd98p/igvYSb2S3vNTgrXSzZJYvhEdaAr4l817lHz/8zMg4gos/tFOMat53QsNPo 7wiw== MIME-Version: 1.0 X-Received: by 10.52.156.116 with SMTP id wd20mr1472677vdb.115.1373576639417; Thu, 11 Jul 2013 14:03:59 -0700 (PDT) Received: by 10.221.37.198 with HTTP; Thu, 11 Jul 2013 14:03:59 -0700 (PDT) In-Reply-To: References: Date: Thu, 11 Jul 2013 14:03:59 -0700 Message-ID: Subject: Re: public_distfile replication From: Peter Wemm To: "Simon L. B. Nielsen" Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQmnJqrcyLatiRnn/vtgcUIdUopQdgerxgRqttPQzLrgrjE/S+ABE9uudyEdsRdO0YCGTR8f Cc: hubs@freebsd.org, Jason Helfman , "FreeBSD.org clusteradm" X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2013 21:04:00 -0000 On Thu, Jul 11, 2013 at 2:57 AM, Simon L. B. Nielsen wrote: > On 11 July 2013 08:31, Jason Helfman wrote: >> Hey Gang... >> >> From looking at some of my public_distfiles, it seems that >> ftp.{cn,se,tw}.freebsd.org don't seem to be receiving public_distfiles per >> replication. I've also seen that ru has issues, as well. > > Are they on ftp.FreeBSD.org ? If they are, it gets to ftp-master and > after that it's out of our hands. Most ftp mirrors are broken because they try to pick out parts of the rsync archive and expand symlinks. I've watched some ftp mirrors rsync 3x to 5x as much data because they fetch a duplicate copy of the data via all the "compatability" symlinks or because they're not preserving hard links. Some of this silliness came about because of rsync all the cvsup and cvsup checkouts had high overheads but these days most should be able to mirror exactly as is, with -H to preserve hard links. A lot of the time consuming things for rsync were tidied up. Regardless, this is not a clusteradm thing. 3rd party mirrors might be reachable via hubs@freebsd.org. All we can do via clusteradm is revoke 3rd party zone delegations to de-list broken ftp mirrors. Most of the subdomains are not under project control in any way. -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV UTF-8: So you can \342\200\231 .. for when a ' just won't do ZFS must be the bacon of file systems. "everything's better with ZFS"