Date: Sat, 2 Oct 2004 18:39:35 -0300 (ADT)
From: "Marc G. Fournier" <scrappy@postgresql.org>
To: Devrim GUNDUZ <devrim@gunduz.org>
Cc: Dave Page <dpage@vale-housing.co.uk>,
	PostgreSQL WWW Mailing List <pgsql-www@postgresql.org>
Subject: Re: Problem with mirrorring
In-Reply-To: <Pine.LNX.4.61.0410022247430.29985@emo.org.tr>
Message-ID: <20041002183746.Y64687@ganymede.hub.org>
References: 
 <E7F85A1B5FF8D44C8A1AF6885BC9A0E430687F@ratbert.vale-housing.co.uk>
	<Pine.LNX.4.61.0410022247430.29985@emo.org.tr>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed


my understanding of rsync is that even if a file changes, only the changes 
are sent across ... I believe its effectively a 'diff' of the file ... so 
even if all files timestamps do change, very little data is sent across 
...

But, aren't there args available for rsync to have it check file size vs 
timestamp?  so it would miss a reversing of characters in a word, but if a 
single character is added, then the byte size changes and, therefore, it 
gets updated ... ?

On Sat, 2 Oct 2004, Devrim GUNDUZ wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
>
> Hi,
>
> On Sat, 2 Oct 2004, Dave Page wrote:
>
>>> There was not an 'error' exactly...
>> 
>> Ahh, yes. Of course, that's actually rsync working correctly! No changes
>> on the server, so no transfers.
>
> Umm, every cron job outputs an email of 259K, but when there is a lockfile, 
> then it decreases to 800 bytes. Rsync gets all the files, even if there is no 
> change!
>
>> This does mean that our mirroring is quite innefficient. We really
>> should diff the results of each build and only update the html files if
>> there is a change. At the moment each mirror is probably pulling the
>> whole site each time :-(
>
> Agreed but... diffing all the files that we have might be quite hard for us 
> -- But I now don't have a better idea...
>
> Umm... If we can keep a track of modified files in a db (a new or updated 
> FAQ, doc, news, etc...) maybe we could publish only them...
>
> Regards,
>
> - --
> Devrim GUNDUZ devrim~gunduz.org 
> devrim.gunduz~linux.org.tr
> 			http://www.tdmsoft.com
> 			http://www.gunduz.org
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.1 (GNU/Linux)
>
> iD8DBQFBXwi2tl86P3SPfQ4RAm2QAKC8muqKCQbalZp1OK+T6uEMRTYtygCfeiqe
> pTOc+oXlqx0ju1R+PpTfXB4=
> =8ZdP
> -----END PGP SIGNATURE-----
>
> ---------------------------(end of broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
>              http://www.postgresql.org/docs/faqs/FAQ.html
>

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664