Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t9PfT-009z7M-Pv for pgsql-admin@arkaria.postgresql.org; Fri, 08 Nov 2024 14:08:55 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1t9PfR-009XuL-4d for pgsql-admin@arkaria.postgresql.org; Fri, 08 Nov 2024 14:08:53 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t9PfQ-009XuD-PD for pgsql-admin@lists.postgresql.org; Fri, 08 Nov 2024 14:08:53 +0000 Received: from mail-oi1-x22a.google.com ([2607:f8b0:4864:20::22a]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1t9PfN-000rHh-EN for pgsql-admin@postgresql.org; Fri, 08 Nov 2024 14:08:52 +0000 Received: by mail-oi1-x22a.google.com with SMTP id 5614622812f47-3e6075cba82so1299249b6e.0 for ; Fri, 08 Nov 2024 06:08:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1731074928; x=1731679728; darn=postgresql.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=Rm/8cozffyq61q83T64nYszI82ArYgtLgybJZ4vOoLo=; b=T4OZbYTxSq4in0SOrpSUTPoNA9WNyvEF6znwgFJlOsc+JP1hKON54gNES1fsrZKUTL MN2w/P4AsSfF1fAppZkDirFcjFpgHHlBNDh7L30jO7D13+Vp/UPbO4RKJ1foLP9nIDdd TAEHjy3oEoZknLSCgrGEMe6kUMIfP2SpUVV5425lNRFSqgbwkKdq1TRwe41+R9cEjb1I hwN/luQdsPPObywsc7cYq4m6f86xNcRFppyMgH4kbkB8+2msbnb6oV5nI4YHce2ITfya AtFvSC/pfyPmVCeRdzQ7A2Qj2qQEjoVnP/8+lsAE7zj2gFXrMOu0nyWyY/N6UWWepoI5 RJjA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731074928; x=1731679728; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Rm/8cozffyq61q83T64nYszI82ArYgtLgybJZ4vOoLo=; b=MLlYGWuCELpbL7S+KkSZunHfZVkTRK32LiIngr3olvva2YqWrHTrhmlR7UsNN9w00x tbF8OHdIQVbwYs0OJ/Xjq9S9dXH5/3CkFD0w6LJV4bV0eyhqTOwzg2Agu0GwrNBsmmkG KBdEoV3v0Ew06YQHhtOUby9kmsXoh0v/X1MkxyDSFSrC5jHjsfxFIyjkZsnKVpArWNpe utCsz/2pOuimaPHtQlDInkpYE/kB2yO6x/SoSHBklolFPzEx4d2mkhjv4GChVblOxpC9 vphyNjhUJI13fPmv+bQW3cLtTZeY21mhrlPY6WC6aXu178yIyLzJj5mGCXcjEeynoq2G r+vQ== X-Gm-Message-State: AOJu0YzIM0H82uu5N2JRF8E8Qjq6GdHlybDltzwZci4PbWPeftboq2rR 6vnT4CvECr+5IT9s9wtJBTHxZtMQNKqDNM3iGgx++Bn/gMz3I88GlGSDOeP2JBk6BZFEN1psiE9 5kLHOfJUP/fXLpin+5V5WDEVXCjIDDQ== X-Google-Smtp-Source: AGHT+IExhuRiKykot8uDTNUr35y0BiAqD3LpIthj3P0LPX77paaHBeWs8d2rpx6mj8RW3PojKFKV0XMfQBgeqKcPelY= X-Received: by 2002:a05:6808:448b:b0:3e4:d4ca:2774 with SMTP id 5614622812f47-3e7946a615amr3686659b6e.20.1731074928285; Fri, 08 Nov 2024 06:08:48 -0800 (PST) MIME-Version: 1.0 References: <01000193082d1077-34d9461d-49e4-44ef-b83a-0201df4fc0ba-000000@email.amazonses.com> In-Reply-To: From: Ron Johnson Date: Fri, 8 Nov 2024 09:08:36 -0500 Message-ID: Subject: Re: Running rsync backups in pg15 To: pgsql-admin Content-Type: multipart/alternative; boundary="0000000000002e1fb80626674acc" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --0000000000002e1fb80626674acc Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, Nov 7, 2024 at 3:59=E2=80=AFPM Murthy Nunna wrote= : > rsync backups are not just incremental backups. They are incremental > merged backups. You always get full backup at the end of the backup. > > > > My database is 18TB. The very first backup took 14 hours. We just keep > overwriting this full backup with daily rsyncs. The daily rsyncs take abo= ut > 15 to 30 minutes depending up on the activity since last backup. > That looks a whole lot like the results you get from async Streaming Replication. Which is, of course, a DR solution, NOT a backup solution. --=20 Death to , and butter sauce. Don't boil me, I'm still alive. lobster! --0000000000002e1fb80626674acc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Thu, Nov 7, 2024 at 3:59=E2=80=AFPM Mu= rthy Nunna <mnunna@fnal.gov> w= rote:

rsync =C2=A0backups a= re not just incremental backups. They are incremental merged backups. You a= lways get full backup at the end of the backup.

=C2=A0<= /span>

My database is 18TB. = The very first backup took 14 hours. We just keep overwriting this full bac= kup with daily rsyncs. The daily rsyncs take about 15 to 30 minutes dependi= ng up on the activity since last backup.


That looks a whole lot like the results you get = from async Streaming Replication.

Which is, of cou= rse, a DR solution, NOT a backup solution.

--
Death to <Redacted>, and butter sauce= .
Don't boil me, I'm still alive.
<Redacted>= lobster!
--0000000000002e1fb80626674acc--