pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Using rsync for base backups for PITR
5+ messages / 3 participants
[nested] [flat]

* Using rsync for base backups for PITR
@ 2007-10-10 16:37  Scott Whitney <swhitney@journyx.com>
  0 siblings, 1 reply; 5+ messages in thread

From: Scott Whitney @ 2007-10-10 16:37 UTC (permalink / raw)
  To: pgsql-admin

I'm reading conflicting information on this. Is this a supported technique?

start_backup
rsync the initial base backup
stop_backup

Then, periodically,
start_backup
rsync again
stop_backup

It's my opinion that this wouuld significantly cut down the 30GB base backup
I'll need to take for each PITR.




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Using rsync for base backups for PITR
@ 2007-10-10 16:39  Bruce Momjian <bruce@momjian.us>
  parent: Scott Whitney <swhitney@journyx.com>
  0 siblings, 1 reply; 5+ messages in thread

From: Bruce Momjian @ 2007-10-10 16:39 UTC (permalink / raw)
  To: Scott Whitney <swhitney@journyx.com>; +Cc: pgsql-admin

Scott Whitney wrote:
> I'm reading conflicting information on this. Is this a supported technique?
> 
> start_backup
> rsync the initial base backup
> stop_backup
> 
> Then, periodically,
> start_backup
> rsync again
> stop_backup
> 
> It's my opinion that this wouuld significantly cut down the 30GB base backup
> I'll need to take for each PITR.

Uh, well, yes, that will work, but you don't have a valid archive
_while_ the rsync is happening.  I think that would be a problem if
there was a failure during the rsync update.

-- 
  Bruce Momjian  <bruce@momjian.us>        http://momjian.us
  EnterpriseDB                             http://postgres.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +



^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Using rsync for base backups for PITR
@ 2007-10-10 16:46  Scott Whitney <swhitney@journyx.com>
  parent: Bruce Momjian <bruce@momjian.us>
  0 siblings, 2 replies; 5+ messages in thread

From: Scott Whitney @ 2007-10-10 16:46 UTC (permalink / raw)
  To: 'Bruce Momjian' <bruce@momjian.us>; +Cc: pgsql-admin

In the same way that you don't have a valid archive while the tar is
running, no? In either case, I have to archive the WAL segments used during
the file system backup, right?

Is rsync a supported method for a warm standby server? Specifically, I'm
thinking about:
http://www.taygeta.com/ha-postgresql.html 

-----Original Message-----
From: Bruce Momjian [mailto:bruce@momjian.us] 
Sent: Oct 10, 2007 11:39 AM
To: Scott Whitney
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Using rsync for base backups for PITR

Scott Whitney wrote:
> I'm reading conflicting information on this. Is this a supported
technique?
> 
> start_backup
> rsync the initial base backup
> stop_backup
> 
> Then, periodically,
> start_backup
> rsync again
> stop_backup
> 
> It's my opinion that this wouuld significantly cut down the 30GB base
backup
> I'll need to take for each PITR.

Uh, well, yes, that will work, but you don't have a valid archive
_while_ the rsync is happening.  I think that would be a problem if
there was a failure during the rsync update.

-- 
  Bruce Momjian  <bruce@momjian.us>        http://momjian.us
  EnterpriseDB                             http://postgres.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Using rsync for base backups for PITR
@ 2007-10-10 16:49  Bruce Momjian <bruce@momjian.us>
  parent: Scott Whitney <swhitney@journyx.com>
  1 sibling, 0 replies; 5+ messages in thread

From: Bruce Momjian @ 2007-10-10 16:49 UTC (permalink / raw)
  To: Scott Whitney <swhitney@journyx.com>; +Cc: pgsql-admin

Scott Whitney wrote:
> In the same way that you don't have a valid archive while the tar is
> running, no? In either case, I have to archive the WAL segments used during
> the file system backup, right?

Well, with the tar I assume you still have the old tar around.  This is
not true with the rsync update you suggested.

> Is rsync a supported method for a warm standby server? Specifically, I'm
> thinking about:
> http://www.taygeta.com/ha-postgresql.html 

Well, the standby is fine while the rsync is not runing, but while
syncing that backup has an inconsistent view of the database.  PITR
works only because the PITR logs fix up any consistencies.  The rsync is
not the same as a file system snapshot.

-- 
  Bruce Momjian  <bruce@momjian.us>        http://momjian.us
  EnterpriseDB                             http://postgres.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +



^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Using rsync for base backups for PITR
@ 2007-10-10 19:01  Simon Riggs <simon@2ndquadrant.com>
  parent: Scott Whitney <swhitney@journyx.com>
  1 sibling, 0 replies; 5+ messages in thread

From: Simon Riggs @ 2007-10-10 19:01 UTC (permalink / raw)
  To: Scott Whitney <swhitney@journyx.com>; +Cc: 'Bruce Momjian' <bruce@momjian.us>; pgsql-admin

On Wed, 2007-10-10 at 11:46 -0500, Scott Whitney wrote:

> Is rsync a supported method for a warm standby server? Specifically, I'm
> thinking about:
> http://www.taygeta.com/ha-postgresql.html 

That's dated 2001... 

-- 
  Simon Riggs
  2ndQuadrant  http://www.2ndQuadrant.com




^ permalink  raw  reply  [nested|flat] 5+ messages in thread


end of thread, other threads:[~2007-10-10 19:01 UTC | newest]

Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2007-10-10 16:37 Using rsync for base backups for PITR Scott Whitney <swhitney@journyx.com>
2007-10-10 16:39 ` Bruce Momjian <bruce@momjian.us>
2007-10-10 16:46   ` Scott Whitney <swhitney@journyx.com>
2007-10-10 16:49     ` Bruce Momjian <bruce@momjian.us>
2007-10-10 19:01     ` Simon Riggs <simon@2ndquadrant.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox