pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Strategies for validating WAL-shipping replication
6+ messages / 5 participants
[nested] [flat]

* Strategies for validating WAL-shipping replication
@ 2008-10-20 06:31 Florian Weimer <fweimer@bfk.de>
  2008-10-20 08:08 ` Re: Strategies for validating WAL-shipping replication wstrzalka <wstrzalka@gmail.com>
  2008-10-20 08:09 ` Re: Strategies for validating WAL-shipping replication Guillaume Lelarge <guillaume@lelarge.info>
  2008-10-20 13:20 ` Re: Strategies for validating WAL-shipping replication Alvaro Herrera <alvherre@commandprompt.com>
  2008-10-20 13:54 ` Re: Strategies for validating WAL-shipping replication Simon Riggs <simon@2ndQuadrant.com>
  0 siblings, 4 replies; 6+ messages in thread

From: Florian Weimer @ 2008-10-20 06:31 UTC (permalink / raw)
  To: pgsql-admin

We've set up WAL-shipping replication on one of our database servers,
and the question is whether it runs correctly.  Is there an easy way
to access some tables and see if the data matches (possibly in
single-user mode)?

Stopping replication and starting the server for real on the replica
means that we have to set up things from scratch, right?  (This is a
bit annoying because of the amount of data which has to be copied from
the master.)

-- 
Florian Weimer                <fweimer@bfk.de>
BFK edv-consulting GmbH       http://www.bfk.de/
Kriegsstraße 100              tel: +49-721-96201-1
D-76133 Karlsruhe             fax: +49-721-96201-99



^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Strategies for validating WAL-shipping replication
  2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
@ 2008-10-20 08:08 ` wstrzalka <wstrzalka@gmail.com>
  2008-10-20 09:05   ` Re: Strategies for validating WAL-shipping replication Simon Riggs <simon@2ndQuadrant.com>
  3 siblings, 1 reply; 6+ messages in thread

From: wstrzalka @ 2008-10-20 08:08 UTC (permalink / raw)
  To: pgsql-admin


There is not such a possibility. However it's on TODO list:
http://wiki.postgresql.org/wiki/Todo
I'm waiting for this feature too.

I can understand your fear about the data, that you can not query for
it. I had the same :)
So script as much as you can, for the rest create a formal procedure -
then repeat it few times and check if everything is correct. After
several tries you'll believe your data are safe. I've a good comfort
level with this.
You can also check & resetup your production from time to time.


On Oct 20, 8:31 am, fwei...@bfk.de (Florian Weimer) wrote:
> We've set up WAL-shipping replication on one of our database servers,
> and the question is whether it runs correctly.  Is there an easy way
> to access some tables and see if the data matches (possibly in
> single-user mode)?
>
> Stopping replication and starting the server for real on the replica
> means that we have to set up things from scratch, right?  (This is a
> bit annoying because of the amount of data which has to be copied from
> the master.)
>
> --
> Florian Weimer                <fwei...@bfk.de>
> BFK edv-consulting GmbH      http://www.bfk.de/
> Kriegsstraße 100              tel: +49-721-96201-1
> D-76133 Karlsruhe             fax: +49-721-96201-99
>
> --
> Sent via pgsql-admin mailing list (pgsql-ad...@postgresql.org)
> To make changes to your subscription:http://www.postgresql.org/mailpref/pgsql-admin




^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Strategies for validating WAL-shipping replication
  2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
  2008-10-20 08:08 ` Re: Strategies for validating WAL-shipping replication wstrzalka <wstrzalka@gmail.com>
@ 2008-10-20 09:05   ` Simon Riggs <simon@2ndQuadrant.com>
  0 siblings, 0 replies; 6+ messages in thread

From: Simon Riggs @ 2008-10-20 09:05 UTC (permalink / raw)
  To: wstrzalka <wstrzalka@gmail.com>; +Cc: pgsql-admin


On Mon, 2008-10-20 at 01:08 -0700, wstrzalka wrote:
> There is not such a possibility. However it's on TODO list:
> http://wiki.postgresql.org/wiki/Todo
> I'm waiting for this feature too.
> 
> I can understand your fear about the data, that you can not query for
> it. 

Please test the Hot Standby patch...

-- 
 Simon Riggs           www.2ndQuadrant.com
 PostgreSQL Training, Services and Support




^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Strategies for validating WAL-shipping replication
  2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
@ 2008-10-20 08:09 ` Guillaume Lelarge <guillaume@lelarge.info>
  3 siblings, 0 replies; 6+ messages in thread

From: Guillaume Lelarge @ 2008-10-20 08:09 UTC (permalink / raw)
  To: Florian Weimer <fweimer@bfk.de>; +Cc: pgsql-admin

Florian Weimer a écrit :
> We've set up WAL-shipping replication on one of our database servers,
> and the question is whether it runs correctly.  Is there an easy way
> to access some tables and see if the data matches (possibly in
> single-user mode)?
> 

Nope. The only way you can look at data on a "on-recovery" server (the
log shipping slave) is to stop the recovery process.

> Stopping replication and starting the server for real on the replica
> means that we have to set up things from scratch, right?  (This is a
> bit annoying because of the amount of data which has to be copied from
> the master.)
> 

Yes.


-- 
Guillaume.
 http://www.postgresqlfr.org
 http://dalibo.com



^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Strategies for validating WAL-shipping replication
  2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
@ 2008-10-20 13:20 ` Alvaro Herrera <alvherre@commandprompt.com>
  3 siblings, 0 replies; 6+ messages in thread

From: Alvaro Herrera @ 2008-10-20 13:20 UTC (permalink / raw)
  To: Florian Weimer <fweimer@bfk.de>; +Cc: pgsql-admin

Florian Weimer wrote:
> We've set up WAL-shipping replication on one of our database servers,
> and the question is whether it runs correctly.  Is there an easy way
> to access some tables and see if the data matches (possibly in
> single-user mode)?
> 
> Stopping replication and starting the server for real on the replica
> means that we have to set up things from scratch, right?  (This is a
> bit annoying because of the amount of data which has to be copied from
> the master.)

The OmniTI guys gave a talk some time ago on how they used Solaris ZFS
to create a filesystem snapshot, on which they stopped the recovery and
started postmaster.  This could run queries.  The original copy
continues running recovery, and whenever you want to "update your
slave", you stop the second postmaster, delete the snapshot, and create
a new one.

Cumbersome ...

-- 
Alvaro Herrera                                http://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support



^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Strategies for validating WAL-shipping replication
  2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
@ 2008-10-20 13:54 ` Simon Riggs <simon@2ndQuadrant.com>
  3 siblings, 0 replies; 6+ messages in thread

From: Simon Riggs @ 2008-10-20 13:54 UTC (permalink / raw)
  To: Florian Weimer <fweimer@bfk.de>; +Cc: pgsql-admin


On Mon, 2008-10-20 at 08:31 +0200, Florian Weimer wrote:

> We've set up WAL-shipping replication on one of our database servers,
> and the question is whether it runs correctly.

There's two answers here. 

The first is that the code used is exactly the same as crash recovery.
So if you trust crash recovery you should trust archive recovery, which
means WAL shipping. The differences are all about where you start and
stop WAL replay.

The second is that any form of replication requires testing.

-- 
 Simon Riggs           www.2ndQuadrant.com
 PostgreSQL Training, Services and Support




^ permalink  raw  reply  [nested|flat] 6+ messages in thread


end of thread, other threads:[~2008-10-20 13:54 UTC | newest]

Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2008-10-20 06:31 Strategies for validating WAL-shipping replication Florian Weimer <fweimer@bfk.de>
2008-10-20 08:08 ` wstrzalka <wstrzalka@gmail.com>
2008-10-20 09:05   ` Simon Riggs <simon@2ndQuadrant.com>
2008-10-20 08:09 ` Guillaume Lelarge <guillaume@lelarge.info>
2008-10-20 13:20 ` Alvaro Herrera <alvherre@commandprompt.com>
2008-10-20 13:54 ` Simon Riggs <simon@2ndQuadrant.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox