pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedBest Replication Tool
8+ messages / 7 participants
[nested] [flat]
* Best Replication Tool
@ 2010-02-08 03:22 Kiswono Prayogo <kiswono@gmail.com>
0 siblings, 3 replies; 8+ messages in thread
From: Kiswono Prayogo @ 2010-02-08 03:22 UTC (permalink / raw)
To: pgsql-admin
Hi, i'm really new to postgresql replication, was there any
replication tool for postgresql that can do real-time replication from
1 database to ~3-10 database (on the other machines) with little
overhead for load balancing purpose?
--
Regards,
Kiswono P
GB
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Best Replication Tool
@ 2010-02-08 03:32 Scott Marlowe <scott.marlowe@gmail.com>
parent: Kiswono Prayogo <kiswono@gmail.com>
2 siblings, 0 replies; 8+ messages in thread
From: Scott Marlowe @ 2010-02-08 03:32 UTC (permalink / raw)
To: Kiswono Prayogo <kiswono@gmail.com>; +Cc: pgsql-admin
On Sun, Feb 7, 2010 at 8:22 PM, Kiswono Prayogo <kiswono@gmail.com> wrote:
> Hi, i'm really new to postgresql replication, was there any
> replication tool for postgresql that can do real-time replication from
> 1 database to ~3-10 database (on the other machines) with little
> overhead for load balancing purpose?
Well, you're not telling us how much traffic you're looking at or how
powerful your servers will be. Where I work we have two large master
servers (lots of SAS drives on power hardware RAID controllers with
battery backed cache) which are our master and slave-master, so to
speak, then we currently have two, but may have more, slaves synced
off of the slave-master machine. We use slony. It works well enough,
but there are some issues with large numbers of db objects (lots of
tables / indexes / schemas) that we've run into with it that are
making me pull some hair out, and I haven't had time to troubleshoot
them.
Overall though, it's a quite capable system, and once it's setup and
running it's fast and stable.
There's also londiste, bucardo, and a few others worth looking at.
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Best Replication Tool
@ 2010-02-08 22:38 Rosser Schwarz <rosser.schwarz@gmail.com>
parent: Kiswono Prayogo <kiswono@gmail.com>
2 siblings, 1 reply; 8+ messages in thread
From: Rosser Schwarz @ 2010-02-08 22:38 UTC (permalink / raw)
To: Kiswono Prayogo <kiswono@gmail.com>; +Cc: pgsql-admin
On Sun, Feb 7, 2010 at 8:22 PM, Kiswono Prayogo <kiswono@gmail.com> wrote:
> Hi, i'm really new to postgresql replication, was there any
> replication tool for postgresql that can do real-time replication from
> 1 database to ~3-10 database (on the other machines) with little
> overhead for load balancing purpose?
If, by "real time", you mean that a tuple created or changed on the
master is visible to queries on an arbitrary slave within a few
seconds, then Bucardo and Slony are both good candidates. I've used
Bucardo in just such an environment, along with its master-master
capability. Of the two, I definitely prefer the former, but this
isn't an advocacy list, and they both work.
The amount of overhead you'll experience is a function of how "chatty"
your data is -- the higher the volume of changes it needs to
replicate, the more work it will take to keep those changes flowing
out to the slave nodes. If you update the same tuple three times in a
five second period, that's three tuples you'll be replicating out to
each slave.
Another important consideration is the size of your replication sets
(in Slony terms; "herds" in Bucardo). The bigger they are -- the more
tables they include -- the more work it will take to replicate any
changes in any of their member objects. IME, you'll typically do well
to keep your sets down to the smallest meaningful groups you can.
Particularly, you'll want to group together tables that are
interrelated by foreign keys (this is especially important if you're
using Slony, and have any plans to support switching masters), or that
you expect to be modified together -- for example, all the tables that
might be modified in the course of a new order being entered into your
OLTP application.
rls
--
:wq
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Best Replication Tool
@ 2010-02-09 06:59 Gerd Koenig <koenig@transporeon.com>
parent: Rosser Schwarz <rosser.schwarz@gmail.com>
0 siblings, 0 replies; 8+ messages in thread
From: Gerd Koenig @ 2010-02-09 06:59 UTC (permalink / raw)
To: pgsql-admin; +Cc: Rosser Schwarz <rosser.schwarz@gmail.com>; Kiswono Prayogo <kiswono@gmail.com>
Hi,
probably pgpool-II is worth trying. A new version has been released two days
ago....
http://pgfoundry.org/projects/pgpool
hth ..:GERD:..
On Monday 08 February 2010 23:38:54 Rosser Schwarz wrote:
> On Sun, Feb 7, 2010 at 8:22 PM, Kiswono Prayogo <kiswono@gmail.com> wrote:
> > Hi, i'm really new to postgresql replication, was there any
> > replication tool for postgresql that can do real-time replication from
> > 1 database to ~3-10 database (on the other machines) with little
> > overhead for load balancing purpose?
>
> If, by "real time", you mean that a tuple created or changed on the
> master is visible to queries on an arbitrary slave within a few
> seconds, then Bucardo and Slony are both good candidates. I've used
> Bucardo in just such an environment, along with its master-master
> capability. Of the two, I definitely prefer the former, but this
> isn't an advocacy list, and they both work.
>
> The amount of overhead you'll experience is a function of how "chatty"
> your data is -- the higher the volume of changes it needs to
> replicate, the more work it will take to keep those changes flowing
> out to the slave nodes. If you update the same tuple three times in a
> five second period, that's three tuples you'll be replicating out to
> each slave.
>
> Another important consideration is the size of your replication sets
> (in Slony terms; "herds" in Bucardo). The bigger they are -- the more
> tables they include -- the more work it will take to replicate any
> changes in any of their member objects. IME, you'll typically do well
> to keep your sets down to the smallest meaningful groups you can.
> Particularly, you'll want to group together tables that are
> interrelated by foreign keys (this is especially important if you're
> using Slony, and have any plans to support switching masters), or that
> you expect to be modified together -- for example, all the tables that
> might be modified in the course of a new order being entered into your
> OLTP application.
>
> rls
>
--
/====================================\
| Gerd König
| - Infrastruktur -
|
| TRANSPOREON GmbH
| Magirus-Deutz-Str. 16
| DE - 89077 Ulm
|
| Tel: +49 [0]731 16906 106
| Fax: +49 [0]731 16906 99
| koenig@transporeon.com
| www.transporeon.com
|
\====================================/
TRANSPOREON GmbH, Amtsgericht Ulm, HRB 722056
Geschäftsf.: Peter Förster, Roland Hötzl, Marc-Oliver Simon
^ permalink raw reply [nested|flat] 8+ messages in thread
* Re: Best Replication Tool
@ 2010-02-09 10:39 Dimitri Fontaine <dfontaine@hi-media.com>
parent: Kiswono Prayogo <kiswono@gmail.com>
2 siblings, 0 replies; 8+ messages in thread
From: Dimitri Fontaine @ 2010-02-09 10:39 UTC (permalink / raw)
To: Kiswono Prayogo <kiswono@gmail.com>; +Cc: pgsql-admin
Kiswono Prayogo <kiswono@gmail.com> writes:
> Hi, i'm really new to postgresql replication, was there any
> replication tool for postgresql that can do real-time replication from
> 1 database to ~3-10 database (on the other machines) with little
> overhead for load balancing purpose?
My prefered asynchronous replication solution for PostgreSQL is Londiste
from Skytools, don't miss its tutorial:
http://wiki.postgresql.org/wiki/Londiste_Tutorial
Regards,
--
dim
^ permalink raw reply [nested|flat] 8+ messages in thread
* Best replication tool
@ 2018-01-22 03:26 Om Prakash Jaiswal <op12om@yahoo.co.in>
0 siblings, 1 reply; 8+ messages in thread
From: Om Prakash Jaiswal @ 2018-01-22 03:26 UTC (permalink / raw)
To: pgsql-admin
Hi all,Which is the best asynchronous replication tool BucardoSymmetricDS Or any other tool in open source at postgresql 9.6 Linux OS RHEL 7.xx
RegardsOm Prakash
Sent from Yahoo Mail on Android
^ permalink raw reply [nested|flat] 8+ messages in thread
* RE: Best replication tool
@ 2018-01-22 05:35 Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
parent: Om Prakash Jaiswal <op12om@yahoo.co.in>
0 siblings, 1 reply; 8+ messages in thread
From: Ahmed, Nawaz @ 2018-01-22 05:35 UTC (permalink / raw)
To: pgsql-admin
Hi,
If it is an async. replication, then I would look no further than PostgreSQL’s native streaming replication functionality.
Best Regards,
Nawaz Ahmed
Software Development Engineer
Fujitsu Australia Software Technology Pty Ltd
14 Rodborough Road, Frenchs Forest NSW 2086, Australia
T +61 2 9452 9027
Nawaz@fast.au.fujitsu.com<mailto:Nawaz@fast.au.fujitsu.com>
fastware.com.au<http://fastware.com.au/;
[cid:image001.jpg@01D3939E.F867E2B0]
[cid:image002.jpg@01D3939E.F867E2B0]
From: Om Prakash Jaiswal [mailto:op12om@yahoo.co.in]
Sent: Monday, 22 January 2018 2:26 PM
To: Pgsql-admin <pgsql-admin@postgresql.org>
Subject: Best replication tool
Hi all,
Which is the best asynchronous replication tool
Bucardo
SymmetricDS
Or any other tool in open source at postgresql 9.6 Linux OS RHEL 7.xx
Regards
Om Prakash
Sent from Yahoo Mail on Android<https://overview.mail.yahoo.com/mobile/?.src=Android;
Disclaimer
The information in this e-mail is confidential and may contain content that is subject to copyright and/or is commercial-in-confidence and is intended only for the use of the above named addressee. If you are not the intended recipient, you are hereby notified that dissemination, copying or use of the information is strictly prohibited. If you have received this e-mail in error, please telephone Fujitsu Australia Software Technology Pty Ltd on + 61 2 9452 9000 or by reply e-mail to the sender and delete the document and all copies thereof.
Whereas Fujitsu Australia Software Technology Pty Ltd would not knowingly transmit a virus within an email communication, it is the receiver’s responsibility to scan all communication and any files attached for computer viruses and other defects. Fujitsu Australia Software Technology Pty Ltd does not accept liability for any loss or damage (whether direct, indirect, consequential or economic) however caused, and whether by negligence or otherwise, which may result directly or indirectly from this communication or any files attached.
If you do not wish to receive commercial and/or marketing email messages from Fujitsu Australia Software Technology Pty Ltd, please email unsubscribe@fast.au.fujitsu.com
Attachments:
image001.jpg (image/jpeg, 7.7K) download
view image
image002.jpg (image/jpeg, 3.8K) download
view image
* RE: Best replication tool
@ 2018-01-22 08:15 Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
parent: Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
0 siblings, 0 replies; 8+ messages in thread
From: Ahmed, Nawaz @ 2018-01-22 08:15 UTC (permalink / raw)
To: pgsql-admin
Hi,
If it’s a multi-master then you are better off with one of those tools. I am sorry, I can’t recommend any from the two because I haven’t used either of them. Although, I have used slony which is complicated to setup but very robust to break.
Best Regards,
Nawaz Ahmed
Software Development Engineer
Fujitsu Australia Software Technology Pty Ltd
14 Rodborough Road, Frenchs Forest NSW 2086, Australia
T +61 2 9452 9027
Nawaz@fast.au.fujitsu.com<mailto:Nawaz@fast.au.fujitsu.com>
fastware.com.au<http://fastware.com.au/;
[cid:image001.jpg@01D393B5.59213AF0]
[cid:image002.jpg@01D393B5.59213AF0]
From: Om Prakash Jaiswal [mailto:op12om@yahoo.co.in]
Sent: Monday, 22 January 2018 6:09 PM
To: Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
Subject: RE: Best replication tool
I need asynchronous multimaster across 40 nodes in WAN.
Sent from Yahoo Mail on Android<https://overview.mail.yahoo.com/mobile/?.src=Android;
On Mon, Jan 22, 2018 at 11:06, Ahmed, Nawaz
<Nawaz@fast.au.fujitsu.com<mailto:Nawaz@fast.au.fujitsu.com>> wrote:
Hi,
If it is an async. replication, then I would look no further than PostgreSQL’s native streaming replication functionality.
Best Regards,
Nawaz Ahmed
Software Development Engineer
Fujitsu Australia Software Technology Pty Ltd
14 Rodborough Road, Frenchs Forest NSW 2086, Australia
T +61 2 9452 9027
Nawaz@fast.au.fujitsu.com<mailto:Nawaz@fast.au.fujitsu.com>
fastware.com.au<http://fastware.com.au/;
[cid:image001.jpg@01D393B5.59213AF0]
[cid:image002.jpg@01D393B5.59213AF0]
From: Om Prakash Jaiswal [mailto:op12om@yahoo.co.in]
Sent: Monday, 22 January 2018 2:26 PM
To: Pgsql-admin <pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>>
Subject: Best replication tool
Hi all,
Which is the best asynchronous replication tool
Bucardo
SymmetricDS
Or any other tool in open source at postgresql 9.6 Linux OS RHEL 7.xx
Regards
Om Prakash
Sent from Yahoo Mail on Android<https://overview.mail.yahoo.com/mobile/?.src=Android;
Disclaimer
The information in this e-mail is confidential and may contain content that is subject to copyright and/or is commercial-in-confidence and is intended only for the use of the above named addressee. If you are not the intended recipient, you are hereby notified that dissemination, copying or use of the information is strictly prohibited. If you have received this e-mail in error, please telephone Fujitsu Australia Software Technology Pty Ltd on + 61 2 9452 9000 or by reply e-mail to the sender and delete the document and all copies thereof.
Whereas Fujitsu Australia Software Technology Pty Ltd would not knowingly transmit a virus within an email communication, it is the receiver’s responsibility to scan all communication and any files attached for computer viruses and other defects. Fujitsu Australia Software Technology Pty Ltd does not accept liability for any loss or damage (whether direct, indirect, consequential or economic) however caused, and whether by negligence or otherwise, which may result directly or indirectly from this communication or any files attached.
If you do not wish to receive commercial and/or marketing email messages from Fujitsu Australia Software Technology Pty Ltd, please email unsubscribe@fast.au.fujitsu.com<mailto:unsubscribe@fast.au.fujitsu.com>
Disclaimer
The information in this e-mail is confidential and may contain content that is subject to copyright and/or is commercial-in-confidence and is intended only for the use of the above named addressee. If you are not the intended recipient, you are hereby notified that dissemination, copying or use of the information is strictly prohibited. If you have received this e-mail in error, please telephone Fujitsu Australia Software Technology Pty Ltd on + 61 2 9452 9000 or by reply e-mail to the sender and delete the document and all copies thereof.
Whereas Fujitsu Australia Software Technology Pty Ltd would not knowingly transmit a virus within an email communication, it is the receiver’s responsibility to scan all communication and any files attached for computer viruses and other defects. Fujitsu Australia Software Technology Pty Ltd does not accept liability for any loss or damage (whether direct, indirect, consequential or economic) however caused, and whether by negligence or otherwise, which may result directly or indirectly from this communication or any files attached.
If you do not wish to receive commercial and/or marketing email messages from Fujitsu Australia Software Technology Pty Ltd, please email unsubscribe@fast.au.fujitsu.com
Attachments:
image001.jpg (image/jpeg, 7.7K) download
view image
image002.jpg (image/jpeg, 3.8K) download
view image
end of thread, other threads:[~2018-01-22 08:15 UTC | newest]
Thread overview: 8+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2010-02-08 03:22 Best Replication Tool Kiswono Prayogo <kiswono@gmail.com>
2010-02-08 03:32 ` Scott Marlowe <scott.marlowe@gmail.com>
2010-02-08 22:38 ` Rosser Schwarz <rosser.schwarz@gmail.com>
2010-02-09 06:59 ` Gerd Koenig <koenig@transporeon.com>
2010-02-09 10:39 ` Dimitri Fontaine <dfontaine@hi-media.com>
2018-01-22 03:26 Best replication tool Om Prakash Jaiswal <op12om@yahoo.co.in>
2018-01-22 05:35 ` RE: Best replication tool Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
2018-01-22 08:15 ` RE: Best replication tool Ahmed, Nawaz <Nawaz@fast.au.fujitsu.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox