Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gSnRD-0001X3-TV for pgsql-admin@arkaria.postgresql.org; Fri, 30 Nov 2018 18:22:52 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1gSnRA-0002Rh-Me for pgsql-admin@arkaria.postgresql.org; Fri, 30 Nov 2018 18:22:48 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gSnRA-0002O9-2u for pgsql-admin@lists.postgresql.org; Fri, 30 Nov 2018 18:22:48 +0000 Received: from st43p00im-zteg10072001.me.com ([17.58.63.167]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gSnR6-0007Oh-9b for pgsql-admin@lists.postgresql.org; Fri, 30 Nov 2018 18:22:45 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mac.com; s=04042017; t=1543602162; bh=sZC2CF1wCHTHFe0R46sb0eDF6Nt9iEo565oPIuHsZOw=; h=Content-Type:Mime-Version:Subject:From:Date:Message-Id:To; b=H57tJKReSb5pIeHN2hbDMp9Wi9ECBaWrS/4At0loVO/qwrY/9b1G5Ip5XZOT3DKEH CCVvyVWymRijhjgnJ9iWtiAh4ulYSFm4rQAjNUrvuRlx67KJd6WTNRoRgDel7jBKRy ax5zxInyq7i2/pT69bb3PPUdy3zDiCRzgAcXbhM513laKpcbcVIth/y2zWRHW1PyoQ ZHbLM0X0LDhoHqZ7U0fqPSn7CQRzAi+xe+NdH8k4M1DqzDh2oZ8p1jKvD9qHf4Jy4v RxTBeGqIu0V6lzRP1rJ2NUVeGJGUADaNEuV0ms+KYfz/Pan0IpR9xSlT6dnXGBnK8G zrUGNgnGYZd7w== Received: from [IPv6:2607:fb90:2424:3ff8:354b:af8c:4c45:94c9] (unknown [172.56.34.173]) by st43p00im-zteg10072001.me.com (Postfix) with ESMTPSA id 6681DC40261; Fri, 30 Nov 2018 18:22:38 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: Backup solution over unreliable network From: Evan Bauer X-Mailer: iPhone Mail (16B92) In-Reply-To: Date: Fri, 30 Nov 2018 13:22:34 -0500 Cc: pgsql-admin@lists.postgresql.org Content-Transfer-Encoding: quoted-printable Message-Id: <20801752-C311-4F70-9D03-08C5E711645C@mac.com> References: To: Achilleas Mantzios X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-11-30_08:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 mlxscore=0 mlxlogscore=919 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1807170000 definitions=main-1811300156 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Achilleas, I may be over-simplifying your situation, but have you considered breaking t= he problem into two pieces? First backing up to a local drive and then usin= g rsync to move those files over the unreliable network to the remote site. Like other who have responded, I can heartily recommend pgbackrest. But if t= he network stinks, then I=E2=80=99d break the problem in two and leave Postg= reSQL out of the network equation. Cheers, Evan Sent from my iPhone > On Nov 30, 2018, at 05:17, Achilleas Mantzios wrote: >=20 > Hello, > we've been running our backup solution for the last 5 months to a second s= ite which has an unreliable network connection. We had problems with barman,= since it doesn't support backup resume, also no option to disable the repli= cation slot, in the sense, that it is better to sacrifice the backup rather t= han fill up the primary with WALs and bring the primary down. Another issue i= s now supporting entirely backing up from the secondary. With barman this is= not possible, streaming (or archiving) must originate from the primary.So I= want to ask two things here : > - Backing up to a remote site over an unreliable channel is a limited use c= ase by itself, it is useful for local PITR restores on specific tables/data,= or in case the whole primary suffers a disaster. Is there any other benefit= that would justify building a solution for it? > - I have only read the best reviews about PgBackRest, can PgBackRest addre= ss those issues? >=20 > Thank you! >=20 > --=20 > Achilleas Mantzios > IT DEV Lead > IT DEPT > Dynacom Tankers Mgmt >=20 >=20