pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedMaster slave replication
14+ messages / 7 participants
[nested] [flat]
* Master slave replication
@ 2018-07-17 12:01 arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:02 ` Re: Master slave replication bhanu prabhakar <bhanu1208@gmail.com>
2018-07-17 12:09 ` Re: Master slave replication Fabio Pardi <f.pardi@portavita.eu>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
0 siblings, 3 replies; 14+ messages in thread
From: arvind chikne @ 2018-07-17 12:01 UTC (permalink / raw)
To: pgsql-admin
Hi,
Pls suggest a good open source replication tool for huge database, I
discovered slonyi but its seems not easy to configure it bit tricky.
--
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-07-17 12:02 ` bhanu prabhakar <bhanu1208@gmail.com>
2018-07-17 12:08 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
2 siblings, 1 reply; 14+ messages in thread
From: bhanu prabhakar @ 2018-07-17 12:02 UTC (permalink / raw)
To: arvind chikne <arvind.chikne@gmail.com>; +Cc: pgsql-admin
Go with shareplex
On Tue, Jul 17, 2018, 5:32 PM arvind chikne <arvind.chikne@gmail.com> wrote:
> Hi,
>
> Pls suggest a good open source replication tool for huge database, I
> discovered slonyi but its seems not easy to configure it bit tricky.
>
>
>
> --
> *Thanks & Regards*
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility before
> printing this e-mail
>
>
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:02 ` Re: Master slave replication bhanu prabhakar <bhanu1208@gmail.com>
@ 2018-07-17 12:08 ` arvind chikne <arvind.chikne@gmail.com>
0 siblings, 0 replies; 14+ messages in thread
From: arvind chikne @ 2018-07-17 12:08 UTC (permalink / raw)
To: bhanu prabhakar <bhanu1208@gmail.com>; +Cc: pgsql-admin
Hi Bhanu,
Thanks, is it open source if yes, I would appreciate if you can share some
document to configure it on ubuntu/centos platform
On Tue, Jul 17, 2018 at 5:32 PM, bhanu prabhakar <bhanu1208@gmail.com>
wrote:
> Go with shareplex
>
> On Tue, Jul 17, 2018, 5:32 PM arvind chikne <arvind.chikne@gmail.com>
> wrote:
>
>> Hi,
>>
>> Pls suggest a good open source replication tool for huge database, I
>> discovered slonyi but its seems not easy to configure it bit tricky.
>>
>>
>>
>> --
>> *Thanks & Regards*
>> Arvind rao chikne
>> 9818979986
>> *Think Green!!!* Please consider your environmental responsibility
>> before printing this e-mail
>>
>>
--
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-07-17 12:09 ` Fabio Pardi <f.pardi@portavita.eu>
2 siblings, 0 replies; 14+ messages in thread
From: Fabio Pardi @ 2018-07-17 12:09 UTC (permalink / raw)
To: pgsql-admin@lists.postgresql.org
streaming replication can do it for you
https://www.postgresql.org/docs/current/static/warm-standby.html#STREAMING-REPLICATION
else pglogical extension might fit too
If i were you, I would not look for something 'easy' but 'robust'
instead. Take into account that any replication mechanism you are going
to use, requires knowledge which takes time to acquire.
regards,
fabio pardi
On 07/17/2018 02:01 PM, arvind chikne wrote:
> Hi,
>
> Pls suggest a good open source replication tool for huge database, I
> discovered slonyi but its seems not easy to configure it bit tricky.
>
>
>
> --
> /Thanks & Regards/
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility
> before printing this e-mail
>
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-07-17 12:44 ` Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Re: Master slave replication Mariel Cherkassky <mariel.cherkassky@gmail.com>
2 siblings, 1 reply; 14+ messages in thread
From: Shreeyansh Dba @ 2018-07-17 12:44 UTC (permalink / raw)
To: arvind chikne <arvind.chikne@gmail.com>; +Cc: pgsql-admin
Hi Arvind,
You can use repmgr tool to build replication, go through the below link.
https://repmgr.org/docs/repmgr.html
Hope this helps.
<http://www.shreeyansh.com;
On Tue, Jul 17, 2018 at 5:31 PM, arvind chikne <arvind.chikne@gmail.com>
wrote:
> Hi,
>
> Pls suggest a good open source replication tool for huge database, I
> discovered slonyi but its seems not easy to configure it bit tricky.
>
>
>
> --
> *Thanks & Regards*
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility before
> printing this e-mail
>
>
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
@ 2018-07-17 13:05 ` Mariel Cherkassky <mariel.cherkassky@gmail.com>
2018-07-20 12:21 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
0 siblings, 1 reply; 14+ messages in thread
From: Mariel Cherkassky @ 2018-07-17 13:05 UTC (permalink / raw)
To: Shreeyansh Dba <shreeyansh2014@gmail.com>; +Cc: arvind chikne <arvind.chikne@gmail.com>; pgsql-admin
I recommend the repmgr tool.
2018-07-17 15:44 GMT+03:00 Shreeyansh Dba <shreeyansh2014@gmail.com>:
> Hi Arvind,
>
> You can use repmgr tool to build replication, go through the below link.
>
> https://repmgr.org/docs/repmgr.html
>
>
> Hope this helps.
>
<http://www.shreeyansh.com;
On Tue, Jul 17, 2018 at 5:31 PM, arvind chikne <arvind.chikne@gmail.com>
wrote:
> Hi,
>
> Pls suggest a good open source replication tool for huge database, I
> discovered slonyi but its seems not easy to configure it bit tricky.
>
>
>
> --
> *Thanks & Regards*
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility before
> printing this e-mail
>
>
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Re: Master slave replication Mariel Cherkassky <mariel.cherkassky@gmail.com>
@ 2018-07-20 12:21 ` arvind chikne <arvind.chikne@gmail.com>
2018-07-21 00:52 ` Re: Master slave replication Ian Lawrence Barwick <barwick@gmail.com>
0 siblings, 1 reply; 14+ messages in thread
From: arvind chikne @ 2018-07-20 12:21 UTC (permalink / raw)
To: Mariel Cherkassky <mariel.cherkassky@gmail.com>; +Cc: Shreeyansh Dba <shreeyansh2014@gmail.com>; pgsql-admin
Hi All,
I am trying to configure repmgr
I am getting following error while Initialise the master server
[2018-07-20 17:41:23] [ERROR] unable to create the function
repmgr_update_last_updated: ERROR: could not access file
"$libdir/repmgr_funcs": No such file or directory
[2018-07-20 17:41:23] [ERROR] Unable to create repmgr schema - see
preceding error message(s); aborting
I already changed the shared_preload_libraries = 'repmgr' in postgres.conf
in master server but still getting the same error pls suggest
On Tue, Jul 17, 2018 at 6:35 PM, Mariel Cherkassky <
mariel.cherkassky@gmail.com> wrote:
> I recommend the repmgr tool.
>
> 2018-07-17 15:44 GMT+03:00 Shreeyansh Dba <shreeyansh2014@gmail.com>:
>
>> Hi Arvind,
>>
>> You can use repmgr tool to build replication, go through the below link.
>>
>> https://repmgr.org/docs/repmgr.html
>>
>>
>> Hope this helps.
>>
>
> <http://www.shreeyansh.com;
>
> On Tue, Jul 17, 2018 at 5:31 PM, arvind chikne <arvind.chikne@gmail.com>
> wrote:
>
>> Hi,
>>
>> Pls suggest a good open source replication tool for huge database, I
>> discovered slonyi but its seems not easy to configure it bit tricky.
>>
>>
>>
>> --
>> *Thanks & Regards*
>> Arvind rao chikne
>> 9818979986
>> *Think Green!!!* Please consider your environmental responsibility
>> before printing this e-mail
>>
>>
>
--
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Re: Master slave replication Mariel Cherkassky <mariel.cherkassky@gmail.com>
2018-07-20 12:21 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-07-21 00:52 ` Ian Lawrence Barwick <barwick@gmail.com>
2018-07-21 04:01 ` Re: Master slave replication suresh neravati <suresh.neravati@yahoo.com>
2018-07-21 12:01 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
0 siblings, 2 replies; 14+ messages in thread
From: Ian Lawrence Barwick @ 2018-07-21 00:52 UTC (permalink / raw)
To: arvind chikne <arvind.chikne@gmail.com>; +Cc: Mariel Cherkassky <mariel.cherkassky@gmail.com>; Shreeyansh Dba <shreeyansh2014@gmail.com>; pgsql-admin
2018-07-20 21:21 GMT+09:00 arvind chikne <arvind.chikne@gmail.com>:
> Hi All,
>
> I am trying to configure repmgr
>
> I am getting following error while Initialise the master server
>
>
> [2018-07-20 17:41:23] [ERROR] unable to create the function
> repmgr_update_last_updated: ERROR: could not access file
> "$libdir/repmgr_funcs": No such file or directory
>
> [2018-07-20 17:41:23] [ERROR] Unable to create repmgr schema - see
> preceding error message(s); aborting
>
> I already changed the shared_preload_libraries = 'repmgr' in postgres.conf
> in master server but still getting the same error pls suggest
>
>
How did you install repmgr, e.g. from an OS package (which?) or from source?
Regards
Ian Barwick
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Re: Master slave replication Mariel Cherkassky <mariel.cherkassky@gmail.com>
2018-07-20 12:21 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-21 00:52 ` Re: Master slave replication Ian Lawrence Barwick <barwick@gmail.com>
@ 2018-07-21 04:01 ` suresh neravati <suresh.neravati@yahoo.com>
1 sibling, 0 replies; 14+ messages in thread
From: suresh neravati @ 2018-07-21 04:01 UTC (permalink / raw)
To: arvind chikne <arvind.chikne@gmail.com>; Ian Lawrence Barwick <barwick@gmail.com>; +Cc: Mariel Cherkassky <mariel.cherkassky@gmail.com>; Shreeyansh Dba <shreeyansh2014@gmail.com>; pgsql-admin
Hi,
There is another open source tool, stolon. sorintlab/stolon This has 3 components, sentinel, keeper and proxy.Sentinel will monitor the Postgresql database master/slave, Keeper will manages the Postgresql database on the node, Proxy maintains the connection coming from application to database.
Stolon will monitor and maintain the streaming replication automatically. In case of Failover/switchover, stolon will take care of changing slave to master and failed master to standby automatically.
Only one additional thing you need is Consul/etcd to store the master/slave instant information by stolon.
This works even for the Kubernates in case if you want to use the Postgresql database on Cloud.
Please let me know if you have any further questions.
Thanks,Suresh Neravati.
|
|
|
| | |
|
|
|
| |
sorintlab/stolon
stolon - PostgreSQL cloud native High Availability and more.
|
|
|
On Friday, July 20, 2018, 5:53:00 PM PDT, Ian Lawrence Barwick <barwick@gmail.com> wrote:
2018-07-20 21:21 GMT+09:00 arvind chikne <arvind.chikne@gmail.com>:
Hi All,
I am trying to configure repmgr
I am getting following error while Initialise the master server
[2018-07-20 17:41:23] [ERROR] unable to create the function repmgr_update_last_updated: ERROR: could not access file "$libdir/repmgr_funcs": No such file or directory
[2018-07-20 17:41:23] [ERROR] Unable to create repmgr schema - see preceding error message(s); aborting
I already changed the shared_preload_libraries = 'repmgr' in postgres.conf in master server but still getting the same error pls suggest
How did you install repmgr, e.g. from an OS package (which?) or from source?
Regards
Ian Barwick
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:44 ` Re: Master slave replication Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Re: Master slave replication Mariel Cherkassky <mariel.cherkassky@gmail.com>
2018-07-20 12:21 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-21 00:52 ` Re: Master slave replication Ian Lawrence Barwick <barwick@gmail.com>
@ 2018-07-21 12:01 ` arvind chikne <arvind.chikne@gmail.com>
1 sibling, 0 replies; 14+ messages in thread
From: arvind chikne @ 2018-07-21 12:01 UTC (permalink / raw)
To: Ian Lawrence Barwick <barwick@gmail.com>; +Cc: Mariel Cherkassky <mariel.cherkassky@gmail.com>; Shreeyansh Dba <shreeyansh2014@gmail.com>; pgsql-admin
yes i installed it through os package apt-get install
On Sat, Jul 21, 2018 at 6:22 AM, Ian Lawrence Barwick <barwick@gmail.com>
wrote:
>
>
> 2018-07-20 21:21 GMT+09:00 arvind chikne <arvind.chikne@gmail.com>:
>
>> Hi All,
>>
>> I am trying to configure repmgr
>>
>> I am getting following error while Initialise the master server
>>
>>
>> [2018-07-20 17:41:23] [ERROR] unable to create the function
>> repmgr_update_last_updated: ERROR: could not access file
>> "$libdir/repmgr_funcs": No such file or directory
>>
>> [2018-07-20 17:41:23] [ERROR] Unable to create repmgr schema - see
>> preceding error message(s); aborting
>>
>> I already changed the shared_preload_libraries = 'repmgr' in
>> postgres.conf in master server but still getting the same error pls suggest
>>
>>
>
> How did you install repmgr, e.g. from an OS package (which?) or from
> source?
>
>
> Regards
>
> Ian Barwick
>
--
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
^ permalink raw reply [nested|flat] 14+ messages in thread
* Master slave replication
@ 2018-09-19 09:54 arvind chikne <arvind.chikne@gmail.com>
2018-09-19 10:14 ` Re: Master slave replication Fabio Pardi <f.pardi@portavita.eu>
0 siblings, 1 reply; 14+ messages in thread
From: arvind chikne @ 2018-09-19 09:54 UTC (permalink / raw)
To: pgsql-admin
Hi All,
I have successfully configured the master slave replication through WAL,
but after some time my px_xlog and log_archive gets full is there any
option to set the limit for the same
*Error*
*cp: error writing
'/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
space left on device*
*2018-09-19 15:19:19 IST [15642-34394] LOG: archive command failed with
exit code 1*
*2018-09-19 15:19:19 IST [15642-34395] DETAIL: The failed archive command
was: cp pg_xlog/00000001000002E0000000D5
/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
*cp: error writing
'/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
space left on device*
*2018-09-19 15:19:20 IST [15642-34396] LOG: archive command failed with
exit code 1*
*2018-09-19 15:19:20 IST [15642-34397] DETAIL: The failed archive command
was: cp pg_xlog/00000001000002E0000000D5
/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
*2018-09-19 15:19:20 IST [15642-34398] WARNING: archiving transaction log
file "00000001000002E0000000D5" failed too many times, will try again later*
*cp: error writing
'/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
space left on device*
*2018-09-19 15:19:24 IST [15642-34399] LOG: archive command failed with
exit code 1*
*2018-09-19 15:19:24 IST [15642-34400] DETAIL: The failed archive command
was: cp pg_xlog/00000001000002E0000000D5
/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
pls see my postgres.conf
*max_wal_size = 100GB*
*archive_mode = on*
*archive_command = 'cp %p /var/lib/postgresql/9.5/main/log_archive/%f'*
*max_wal_senders = 5 *
*wal_keep_segments = 32 *
*hot_standby = on*
My recovery.conf
*standby_mode = 'on'*
*primary_conninfo = 'host=XXX.XXX.XXX.XXX port=5432 user=rep password=REP'*
*trigger_file = '/tmp/postgresql.trigger.5432'*
*restore_command = 'cp /var/lib/postgresql/9.5/main/log_archive/%f "%p"'*
*archive_cleanup_command = 'pg_archivecleanup
/var/lib/postgresql/9.5/main/log_archive/ %r'*
*-- *
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-09-19 09:54 Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-09-19 10:14 ` Fabio Pardi <f.pardi@portavita.eu>
2018-09-19 10:22 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
0 siblings, 1 reply; 14+ messages in thread
From: Fabio Pardi @ 2018-09-19 10:14 UTC (permalink / raw)
To: pgsql-admin@lists.postgresql.org
Hi Arvind,
^ permalink raw reply [nested|flat] 14+ messages in thread
* Re: Master slave replication
2018-09-19 09:54 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-09-19 10:14 ` Re: Master slave replication Fabio Pardi <f.pardi@portavita.eu>
@ 2018-09-19 10:22 ` arvind chikne <arvind.chikne@gmail.com>
2018-09-19 11:39 ` Re: Master slave replication Fabio Pardi <f.pardi@portavita.eu>
0 siblings, 1 reply; 14+ messages in thread
From: arvind chikne @ 2018-09-19 10:22 UTC (permalink / raw)
To: f.pardi@portavita.eu; +Cc: pgsql-admin@lists.postgresql.org
Hi Fabio,
Thanks for your comment but my px_xlog, log_archive and data_dir all three
are in the different-different partition.
pls see the attached snapshot
[image: image.png]
On Wed, Sep 19, 2018 at 3:44 PM Fabio Pardi <f.pardi@portavita.eu> wrote:
> Hi Arvind,
>
> From what you describe, looks like you are sharing WAL and archive under
> the same partition. It is not good idea.
>
> A lot depends from how much disk space you have available and how you
> setup the disks, but from what i see, max_wal_size in your configuration
> is quite big. I would set it to something smaller, and make sure that
> archive, data and pg_xlog are on different partitions or better, disks
>
>
> https://www.postgresql.org/docs/9.5/static/runtime-config-wal.html#GUC-MAX-WAL-SIZE
>
> regards,
>
> fabio pardi
>
>
>
> On 19/09/18 11:54, arvind chikne wrote:
>
> Hi All,
>
> I have successfully configured the master slave replication through WAL,
> but after some time my px_xlog and log_archive gets full is there any
> option to set the limit for the same
>
>
> *Error*
> *cp: error writing
> '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
> space left on device*
> *2018-09-19 15:19:19 IST [15642-34394] LOG: archive command failed with
> exit code 1*
> *2018-09-19 15:19:19 IST [15642-34395] DETAIL: The failed archive command
> was: cp pg_xlog/00000001000002E0000000D5
> /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
> *cp: error writing
> '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
> space left on device*
> *2018-09-19 15:19:20 IST [15642-34396] LOG: archive command failed with
> exit code 1*
> *2018-09-19 15:19:20 IST [15642-34397] DETAIL: The failed archive command
> was: cp pg_xlog/00000001000002E0000000D5
> /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
> *2018-09-19 15:19:20 IST [15642-34398] WARNING: archiving transaction log
> file "00000001000002E0000000D5" failed too many times, will try again later*
> *cp: error writing
> '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No
> space left on device*
> *2018-09-19 15:19:24 IST [15642-34399] LOG: archive command failed with
> exit code 1*
> *2018-09-19 15:19:24 IST [15642-34400] DETAIL: The failed archive command
> was: cp pg_xlog/00000001000002E0000000D5
> /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
>
> pls see my postgres.conf
> *max_wal_size = 100GB*
>
> *archive_mode = on *
>
> *archive_command = 'cp %p /var/lib/postgresql/9.5/main/log_archive/%f' *
>
> *max_wal_senders = 5 *
>
> *wal_keep_segments = 32 *
>
> *hot_standby = on *
>
> My recovery.conf
> *standby_mode = 'on'*
> *primary_conninfo = 'host=XXX.XXX.XXX.XXX port=5432 user=rep password=REP'*
>
> *trigger_file = '/tmp/postgresql.trigger.5432'*
> *restore_command = 'cp /var/lib/postgresql/9.5/main/log_archive/%f "%p"'*
> *archive_cleanup_command = 'pg_archivecleanup
> /var/lib/postgresql/9.5/main/log_archive/ %r'*
>
>
>
> *-- *
> *Thanks & Regards*
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility before
> printing this e-mail
>
>
>
--
*Thanks & Regards*
Arvind rao chikne
9818979986
*Think Green!!!* Please consider your environmental responsibility before
printing this e-mail
Attachments:
image.png (image/png, 28.0K) download
view image
* Re: Master slave replication
2018-09-19 09:54 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-09-19 10:14 ` Re: Master slave replication Fabio Pardi <f.pardi@portavita.eu>
2018-09-19 10:22 ` Re: Master slave replication arvind chikne <arvind.chikne@gmail.com>
@ 2018-09-19 11:39 ` Fabio Pardi <f.pardi@portavita.eu>
0 siblings, 0 replies; 14+ messages in thread
From: Fabio Pardi @ 2018-09-19 11:39 UTC (permalink / raw)
To: arvind chikne <arvind.chikne@gmail.com>; +Cc: pgsql-admin@lists.postgresql.org
Hi Arvind,
I got fooled by your statement 'my px_xlog and log_archive gets full'...
What probably is happening, is that first your archive folder gets full, then your pg_xlog starts to fill up until full. Then db stops operations.
That is normal, because if the archive folder gets full, then WAL files are retained and start to pile up on your pg_xlog folder until it becomes full too or the archiving is possible again.
Is good practice to give some intelligence to the archive command and take actions if the archive is (getting) full.
Together with a cronjob which archives or deletes WAL files present in the archive older than your retention period.
regards,
fabio pardi
On 19/09/18 12:22, arvind chikne wrote:
> Hi Fabio,
>
> Thanks for your comment but my px_xlog, log_archive and data_dir all three are in the different-different partition.
> pls see the attached snapshot
> image.png
>
> On Wed, Sep 19, 2018 at 3:44 PM Fabio Pardi <f.pardi@portavita.eu <mailto:f.pardi@portavita.eu>> wrote:
>
> Hi Arvind,
>
> From what you describe, looks like you are sharing WAL and archive under the same partition.It is not good idea.
>
> A lot depends from how much disk space you have available and how you setup the disks, but from what i see, max_wal_size in your configuration is quite big. I would set it to something smaller, and make sure that archive, data and pg_xlog are on different partitionsor better, disks
>
> https://www.postgresql.org/docs/9.5/static/runtime-config-wal.html#GUC-MAX-WAL-SIZE
>
> regards,
>
> fabio pardi
>
>
>
> On 19/09/18 11:54, arvind chikne wrote:
>> Hi All,
>>
>> I have successfully configured the master slave replication through WAL, but after some time my px_xlog and log_archive gets full is there any option to set the limit for the same
>>
>> *
>> *
>> *Error*
>> *cp: error writing '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No space left on device*
>> *2018-09-19 15:19:19 IST [15642-34394] LOG: archive command failed with exit code 1*
>> *2018-09-19 15:19:19 IST [15642-34395] DETAIL: The failed archive command was: cp pg_xlog/00000001000002E0000000D5 /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
>> *cp: error writing '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No space left on device*
>> *2018-09-19 15:19:20 IST [15642-34396] LOG: archive command failed with exit code 1*
>> *2018-09-19 15:19:20 IST [15642-34397] DETAIL: The failed archive command was: cp pg_xlog/00000001000002E0000000D5 /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
>> *2018-09-19 15:19:20 IST [15642-34398] WARNING: archiving transaction log file "00000001000002E0000000D5" failed too many times, will try again later*
>> *cp: error writing '/var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5': No space left on device*
>> *2018-09-19 15:19:24 IST [15642-34399] LOG: archive command failed with exit code 1*
>> *2018-09-19 15:19:24 IST [15642-34400] DETAIL: The failed archive command was: cp pg_xlog/00000001000002E0000000D5 /var/lib/postgresql/9.5/main/log_archive/00000001000002E0000000D5*
>> *
>> *
>> pls see my postgres.conf
>> *max_wal_size = 100GB*
>> *archive_mode = on
>> *
>> *archive_command = 'cp %p /var/lib/postgresql/9.5/main/log_archive/%f'
>> *
>> *max_wal_senders = 5
>> *
>> *wal_keep_segments = 32
>> *
>> *hot_standby = on
>> *
>> *
>> *
>> My recovery.conf
>> *standby_mode = 'on'*
>> *primary_conninfo = 'host=XXX.XXX.XXX.XXX port=5432 user=rep password=REP'*
>> *
>> *
>> *trigger_file = '/tmp/postgresql.trigger.5432'*
>> *restore_command = 'cp /var/lib/postgresql/9.5/main/log_archive/%f "%p"'*
>> *archive_cleanup_command = 'pg_archivecleanup /var/lib/postgresql/9.5/main/log_archive/ %r'*
>> *
>> *
>> *
>> *
>> *--
>> *
>> /Thanks & Regards/
>> Arvind rao chikne
>> 9818979986
>> *Think Green!!!* Please consider your environmental responsibility before printing this e-mail
>>
>
>
>
> --
> /Thanks & Regards/
> Arvind rao chikne
> 9818979986
> *Think Green!!!* Please consider your environmental responsibility before printing this e-mail
>
Attachments:
image.png (image/png, 28.0K) download
view image
end of thread, other threads:[~2018-09-19 11:39 UTC | newest]
Thread overview: 14+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2018-07-17 12:01 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:02 ` bhanu prabhakar <bhanu1208@gmail.com>
2018-07-17 12:08 ` arvind chikne <arvind.chikne@gmail.com>
2018-07-17 12:09 ` Fabio Pardi <f.pardi@portavita.eu>
2018-07-17 12:44 ` Shreeyansh Dba <shreeyansh2014@gmail.com>
2018-07-17 13:05 ` Mariel Cherkassky <mariel.cherkassky@gmail.com>
2018-07-20 12:21 ` arvind chikne <arvind.chikne@gmail.com>
2018-07-21 00:52 ` Ian Lawrence Barwick <barwick@gmail.com>
2018-07-21 04:01 ` suresh neravati <suresh.neravati@yahoo.com>
2018-07-21 12:01 ` arvind chikne <arvind.chikne@gmail.com>
2018-09-19 09:54 Master slave replication arvind chikne <arvind.chikne@gmail.com>
2018-09-19 10:14 ` Fabio Pardi <f.pardi@portavita.eu>
2018-09-19 10:22 ` arvind chikne <arvind.chikne@gmail.com>
2018-09-19 11:39 ` Fabio Pardi <f.pardi@portavita.eu>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox