Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id D487E19C35AA for ; Thu, 17 Nov 2011 13:45:35 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 33214-09 for ; Thu, 17 Nov 2011 17:45:29 +0000 (UTC) Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id 9CAB619C35A9 for ; Thu, 17 Nov 2011 13:45:29 -0400 (AST) Received: from asbnvacz-mailrelay01.megapath.net ([207.145.128.243]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1RR61e-0005WY-Bm for pgsql-admin@postgresql.org; Thu, 17 Nov 2011 17:45:29 +0000 Received: from mail3.sea5.speakeasy.net (mail3.sea5.speakeasy.net [69.17.117.42]) by asbnvacz-mailrelay01.megapath.net (Postfix) with ESMTP id 3AEA0A71978 for ; Thu, 17 Nov 2011 12:45:13 -0500 (EST) Received: (qmail 15197 invoked from network); 17 Nov 2011 17:45:12 -0000 Received: by simscan 1.4.0 ppid: 14368, pid: 24411, t: 0.4238s scanners: clamav: 0.88.2/m:52/d:10739 spam: 3.0.4 Received: from 25-76-42-72.skybeam.com (HELO [192.168.2.16]) (sribe@elevated-dev.com@[72.42.76.25]) (envelope-sender ) by mail3.sea5.speakeasy.net (qmail-ldap-1.03) with AES128-SHA encrypted SMTP for ; 17 Nov 2011 17:45:12 -0000 Subject: Re: rsync and streaming replication Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Scott Ribe In-Reply-To: Date: Thu, 17 Nov 2011 10:45:10 -0700 Cc: =?iso-8859-1?Q?C=E9dric_Villemain?= , "[ADMIN]" Content-Transfer-Encoding: quoted-printable Message-Id: References: <87pqgxf8p9.fsf@comcast.net> <639B3C52-BF6D-4CE9-A710-75D369E9607E@elevated-dev.com> <39A965E0-DE37-41F3-8D69-321419BB8B09@elevated-dev.com> <640CEEBE-CB12-4FC9-9758-0319A49E7ACF@elevated-dev.com> <48B4CE29-7776-4D7A-8A A5-D45A4F77BB75@elevated-dev.com> To: Jean-Armel Luce X-Mailer: Apple Mail (2.1084) X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.18 tagged_above=-10 required=5 tests=BAYES_00=-1.9, SARE_SPEC_REPLICA=0.72 X-Spam-Level: X-Archive-Number: 201111/96 X-Sequence-Number: 38690 On Nov 17, 2011, at 10:11 AM, Jean-Armel Luce wrote: > > Also, I believe you said -z seemed to slow it down?=20 > I confirm=20 Is there a lot of your data that is already compressed? Either something = like images which you are storing as bytea or large objects? Or long = text values that pg will itself compress out of line? > Today, I tried with command : rsync -rc --block-size=3D8192=20 > Rsync duration with blksize=3D8192 was 31 minutes (yesterday without = blocksize, duration was 32 minutes exactly) That seems not too bad, in that you're sustaining >3GB/min of reading & = checksumming. (Some of my earlier comments were based on the belief that = your db was 20GB.) --=20 Scott Ribe scott_ribe@elevated-dev.com http://www.elevated-dev.com/ (303) 722-0567 voice