pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Postgres replication solutions
5+ messages / 3 participants
[nested] [flat]

* Postgres replication solutions
@ 2006-07-28 14:11 Mario Splivalo <mario.splivalo@mobart.hr>
  2006-07-28 18:01 ` Re: Postgres replication solutions Jeff Frost <jeff@frostconsultingllc.com>
  0 siblings, 1 reply; 5+ messages in thread

From: Mario Splivalo @ 2006-07-28 14:11 UTC (permalink / raw)
  To: pgsql-admin

Besides slony, is there any other postgres replication active project? I
I need a solution where I could mirror a database to a 'spare' server,
for statistical analysis (just SELECTs beeing done there), and 'lag'
between actuall data and the slave server synchronisation can be even
few hours.

It would be awesome if it's not trigger-based.

I looked on gborg.postgres.org, there are numerous replication projects,
but for most of them last activity was in 2002. On pgfoundry I found
nothing (I haven't spent much time there since the web-site is awfully
slow).

So, I'd like a recommendation.

	Mario
-- 
Mario Splivalo
Mob-Art
mario.splivalo@mobart.hr

"I can do it quick, I can do it cheap, I can do it well. Pick any two."





^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Postgres replication solutions
  2006-07-28 14:11 Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
@ 2006-07-28 18:01 ` Jeff Frost <jeff@frostconsultingllc.com>
  2006-07-29 18:59   ` Re: Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
  0 siblings, 1 reply; 5+ messages in thread

From: Jeff Frost @ 2006-07-28 18:01 UTC (permalink / raw)
  To: Mario Splivalo <mario.splivalo@mobart.hr>; +Cc: pgsql-admin

Mario,

There's also Command Prompt's Mammoth replicator: 
http://commandprompt.com/products/mammothreplicator/

Also, you could batch up PITR restores or even just dump restores if the 
timing was acceptable and you could afford the replicated DB to be down during 
those batch updates.

Another option is using pgpool's replication.

On Fri, 28 Jul 2006, Mario Splivalo wrote:

> Besides slony, is there any other postgres replication active project? I
> I need a solution where I could mirror a database to a 'spare' server,
> for statistical analysis (just SELECTs beeing done there), and 'lag'
> between actuall data and the slave server synchronisation can be even
> few hours.
>
> It would be awesome if it's not trigger-based.
>
> I looked on gborg.postgres.org, there are numerous replication projects,
> but for most of them last activity was in 2002. On pgfoundry I found
> nothing (I haven't spent much time there since the web-site is awfully
> slow).
>
> So, I'd like a recommendation.
>
> 	Mario
>

-- 
Jeff Frost, Owner 	<jeff@frostconsultingllc.com>
Frost Consulting, LLC 	http://www.frostconsultingllc.com/
Phone: 650-780-7908	FAX: 650-649-1954



^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Postgres replication solutions
  2006-07-28 14:11 Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
  2006-07-28 18:01 ` Re: Postgres replication solutions Jeff Frost <jeff@frostconsultingllc.com>
@ 2006-07-29 18:59   ` Mario Splivalo <mario.splivalo@mobart.hr>
  2006-07-29 19:10     ` Re: Postgres replication solutions Jeff Frost <jeff@frostconsultingllc.com>
  2006-07-29 21:06     ` Re: Postgres replication solutions Joshua D. Drake <jd@commandprompt.com>
  0 siblings, 2 replies; 5+ messages in thread

From: Mario Splivalo @ 2006-07-29 18:59 UTC (permalink / raw)
  To: Jeff Frost <jeff@frostconsultingllc.com>; +Cc: pgsql-admin

On Fri, 2006-07-28 at 11:01 -0700, Jeff Frost wrote:
> Mario,
> 
> There's also Command Prompt's Mammoth replicator: 
> http://commandprompt.com/products/mammothreplicator/

I sent an email asking if they have an evaluation version of some
sort...

> Also, you could batch up PITR restores or even just dump restores if the 
> timing was acceptable and you could afford the replicated DB to be down during 
> those batch updates.

Dump restores are what we're using now, but we're soon going to have to
abandon that approach. The dump/restore cycle takes around 20 minutes,
and we're expecting rapid growth of the database. The another problem is
that Tomcat won't release connections to postgres unless you stop it. 

PIRT restores are not working for me. I did it like this: I issued
pg_start_backup, then I 'tar cvf - pg_data/ | nc destination 9876'-ed
the cluster directory, when that was done i did pg_stop_backup, after
that I deleted pg_xlog directory, and put new WAL files (created after
backup begun) in directory specified in restore.conf. I started
postgres, everything went ok. Postgres replayed wal files, and system
was ready. Then, when new WAL files arrived, I shut down postgres, put
WAL files in place, restarted postgres, but it complained, and didn't
replay newly created wal files. It only does so when I 'recreate'
original filesystem backup.

> Another option is using pgpool's replication.

I considered that too, but that adds another layer between the clients
and postgres itself, and it allows for only two servers, and I realy
don't need failover cluster capabilities.

	Mike




^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Postgres replication solutions
  2006-07-28 14:11 Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
  2006-07-28 18:01 ` Re: Postgres replication solutions Jeff Frost <jeff@frostconsultingllc.com>
  2006-07-29 18:59   ` Re: Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
@ 2006-07-29 19:10     ` Jeff Frost <jeff@frostconsultingllc.com>
  1 sibling, 0 replies; 5+ messages in thread

From: Jeff Frost @ 2006-07-29 19:10 UTC (permalink / raw)
  To: Mario Splivalo <mario.splivalo@mobart.hr>; +Cc: pgsql-admin

On Sat, 29 Jul 2006, Mario Splivalo wrote:

> PIRT restores are not working for me. I did it like this: I issued
> pg_start_backup, then I 'tar cvf - pg_data/ | nc destination 9876'-ed
> the cluster directory, when that was done i did pg_stop_backup, after
> that I deleted pg_xlog directory, and put new WAL files (created after
> backup begun) in directory specified in restore.conf. I started
> postgres, everything went ok. Postgres replayed wal files, and system
> was ready. Then, when new WAL files arrived, I shut down postgres, put
> WAL files in place, restarted postgres, but it complained, and didn't
> replay newly created wal files. It only does so when I 'recreate'
> original filesystem backup.

That is how PITR works.  You will always have to redo the base backup before 
being able to restore again, can't just start the replay from a previously 
restored version.  You could however, just replay from your original base 
backup if you're keeping those archived WAL files.

>
>> Another option is using pgpool's replication.
>
> I considered that too, but that adds another layer between the clients
> and postgres itself, and it allows for only two servers, and I realy
> don't need failover cluster capabilities.
>
> 	Mike
>
>
>

-- 
Jeff Frost, Owner 	<jeff@frostconsultingllc.com>
Frost Consulting, LLC 	http://www.frostconsultingllc.com/
Phone: 650-780-7908	FAX: 650-649-1954



^ permalink  raw  reply  [nested|flat] 5+ messages in thread

* Re: Postgres replication solutions
  2006-07-28 14:11 Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
  2006-07-28 18:01 ` Re: Postgres replication solutions Jeff Frost <jeff@frostconsultingllc.com>
  2006-07-29 18:59   ` Re: Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
@ 2006-07-29 21:06     ` Joshua D. Drake <jd@commandprompt.com>
  1 sibling, 0 replies; 5+ messages in thread

From: Joshua D. Drake @ 2006-07-29 21:06 UTC (permalink / raw)
  To: mario.splivalo@mobart.hr; +Cc: Jeff Frost <jeff@frostconsultingllc.com>; pgsql-admin

Mario Splivalo wrote:
> On Fri, 2006-07-28 at 11:01 -0700, Jeff Frost wrote:
>> Mario,
>>
>> There's also Command Prompt's Mammoth replicator: 
>> http://commandprompt.com/products/mammothreplicator/
> 
> I sent an email asking if they have an evaluation version of some
> sort...

We do, but our 1.7 8.1 version won't be out for another couple of weeks 
(hoping just in time for LinuxWorld).

Joshua D. Drake

-- 

    === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
    Providing the most comprehensive  PostgreSQL solutions since 1997
              http://www.commandprompt.com/





^ permalink  raw  reply  [nested|flat] 5+ messages in thread


end of thread, other threads:[~2006-07-29 21:06 UTC | newest]

Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-07-28 14:11 Postgres replication solutions Mario Splivalo <mario.splivalo@mobart.hr>
2006-07-28 18:01 ` Jeff Frost <jeff@frostconsultingllc.com>
2006-07-29 18:59   ` Mario Splivalo <mario.splivalo@mobart.hr>
2006-07-29 19:10     ` Jeff Frost <jeff@frostconsultingllc.com>
2006-07-29 21:06     ` Joshua D. Drake <jd@commandprompt.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox