pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedWarm-Backup configuration question
4+ messages / 3 participants
[nested] [flat]
* Warm-Backup configuration question
@ 2007-08-23 23:54 Kenji Morishige <kenjim@juniper.net>
0 siblings, 2 replies; 4+ messages in thread
From: Kenji Morishige @ 2007-08-23 23:54 UTC (permalink / raw)
To: pgsql-admin; +Cc: kenjim@juniper.net
I've got 2 identical servers configured exactly the same way, except for some
minor differences for the WAL logging directories. I have both machines set up
as a NFS server and client, so that the WAL archive gets written out to the
local filesystem of the backup machine depending on which role the machine is
currently configured for.
I've been able to get the backup server syncronized by using the recover.conf
file as described in the documenation, but I can't seem to write a generic shell
script that will keep the warm-backup in a continously syncronizing mode. It
always stops and renames the recover.conf to recover.done.
I've tried to write an alternate restore command as follows:
#!/usr/local/bin/bash
if [ -e /export/raid/pgsql/recovery.stop ]; then
exit 1
fi
if [ -e $1 ]; then
`/bin/cp $1 $2`
fi
sleep 5
exit 0
The documenation says that it should return 0 only if it is successfull. My
understanding is that the recovery script should continuously try to copy the
archived data to the WAL directory so that the WARM-BACKUP server can
syncronize. I'd like to have the WARM-BACKUP always be only a few minutes
behind in syncronization from the PRIMARY without human intervention. I can
write a cronjob to clean out the WAL archive directory accordingly.
I would be extremely gratefull for any assistance from anyone with a similar
configuration. I must be confused by how the restore_command is supposed to
work.
Sincerely,
Kenji
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Warm-Backup configuration question
@ 2007-08-24 01:54 Tom Arthurs <tarthurs@jobflash.com>
parent: Kenji Morishige <kenjim@juniper.net>
1 sibling, 0 replies; 4+ messages in thread
From: Tom Arthurs @ 2007-08-24 01:54 UTC (permalink / raw)
To: Kenji Morishige <kenjim@juniper.net>; +Cc: pgsql-admin
You need to make the script wait forever for the next archive file, or
return 1 only if you want to complete the recovery. Here's a stub of
what we do:
#!/usr/bin/ksh
set -e
# Where copy.sh fetches WALs from
ARCHDIR=/data3/archive_log
# Name of log file that copy.sh writes to
copy_log=copy.log
# Name of stop file that copy looks for to signal "go live"
copy_stop=copy.stop
# How many seconds sleep between copy iterations
seconds=15
# Expected size of WAL file
size=16777216
src=$1
dest=$2
base=$(basename $src)
exec >>$copy_log
exec 2>&1
echo $base
case $base in
*.history)
echo "\tignored"
exit 1
;;
*.backup)
size=+0
;;
esac
while :; do
if [ -f $copy_stop ]; then
echo "\tstop file"
rm $copy_stop
exit 1
fi
if [ -f "$src" ]; then
if [ "$(find $src -size ${size}c)" ]; then
echo "\tfound"
cp $src $dest
exit 0
else
echo "\ttoo small"
fi
fi
echo "\tsleeping $seconds"
sleep $seconds
done
Kenji Morishige wrote:
> I've got 2 identical servers configured exactly the same way, except for some
> minor differences for the WAL logging directories. I have both machines set up
> as a NFS server and client, so that the WAL archive gets written out to the
> local filesystem of the backup machine depending on which role the machine is
> currently configured for.
>
> I've been able to get the backup server syncronized by using the recover.conf
> file as described in the documenation, but I can't seem to write a generic shell
> script that will keep the warm-backup in a continously syncronizing mode. It
> always stops and renames the recover.conf to recover.done.
>
> I've tried to write an alternate restore command as follows:
>
> #!/usr/local/bin/bash
> if [ -e /export/raid/pgsql/recovery.stop ]; then
> exit 1
> fi
> if [ -e $1 ]; then
> `/bin/cp $1 $2`
> fi
> sleep 5
> exit 0
>
> The documenation says that it should return 0 only if it is successfull. My
> understanding is that the recovery script should continuously try to copy the
> archived data to the WAL directory so that the WARM-BACKUP server can
> syncronize. I'd like to have the WARM-BACKUP always be only a few minutes
> behind in syncronization from the PRIMARY without human intervention. I can
> write a cronjob to clean out the WAL archive directory accordingly.
>
> I would be extremely gratefull for any assistance from anyone with a similar
> configuration. I must be confused by how the restore_command is supposed to
> work.
>
> Sincerely,
> Kenji
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
>
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Warm-Backup configuration question
@ 2007-08-24 04:18 Mikko Partio <mpartio@gmail.com>
parent: Kenji Morishige <kenjim@juniper.net>
1 sibling, 1 reply; 4+ messages in thread
From: Mikko Partio @ 2007-08-24 04:18 UTC (permalink / raw)
To: Kenji Morishige <kenjim@juniper.net>; +Cc: pgsql-admin
On 8/24/07, Kenji Morishige <kenjim@juniper.net> wrote:
>
> I've got 2 identical servers configured exactly the same way, except for
> some
> minor differences for the WAL logging directories. I have both machines
> set up
> as a NFS server and client, so that the WAL archive gets written out to
> the
> local filesystem of the backup machine depending on which role the machine
> is
> currently configured for.
>
> I've been able to get the backup server syncronized by using the
> recover.conf
> file as described in the documenation, but I can't seem to write a generic
> shell
> script that will keep the warm-backup in a continously syncronizing
> mode. It
> always stops and renames the recover.conf to recover.done.
>
> I've tried to write an alternate restore command as follows:
>
> #!/usr/local/bin/bash
> if [ -e /export/raid/pgsql/recovery.stop ]; then
> exit 1
> fi
> if [ -e $1 ]; then
> `/bin/cp $1 $2`
> fi
> sleep 5
> exit 0
>
> The documenation says that it should return 0 only if it is
> successfull. My
> understanding is that the recovery script should continuously try to copy
> the
> archived data to the WAL directory so that the WARM-BACKUP server can
> syncronize. I'd like to have the WARM-BACKUP always be only a few minutes
> behind in syncronization from the PRIMARY without human intervention. I
> can
> write a cronjob to clean out the WAL archive directory accordingly.
>
> I would be extremely gratefull for any assistance from anyone with a
> similar
> configuration. I must be confused by how the restore_command is supposed
> to
> work.
>
>
>
Why don't you just use pg_standby from contrib.
Regards
MP
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Warm-Backup configuration question
@ 2007-08-24 22:05 Kenji Morishige <kenjim@juniper.net>
parent: Mikko Partio <mpartio@gmail.com>
0 siblings, 0 replies; 4+ messages in thread
From: Kenji Morishige @ 2007-08-24 22:05 UTC (permalink / raw)
To: Mikko Partio <mpartio@gmail.com>; +Cc: pgsql-admin; kenjim@juniper.net
Hmm. I recently installed 8.2.4 out of ports (FreeBSD) and didn't see that file
in contrib. I'd like to take a look at it.
Kenji
On Fri, Aug 24, 2007 at 07:18:12AM +0300, Mikko Partio wrote:
>
>
> On 8/24/07, Kenji Morishige <kenjim@juniper.net> wrote:
>
> I've got 2 identical servers configured exactly the same way, except for
> some
> minor differences for the WAL logging directories. I have both machines
> set up
> as a NFS server and client, so that the WAL archive gets written out to the
> local filesystem of the backup machine depending on which role the machine
> is
> currently configured for.
>
> I've been able to get the backup server syncronized by using the
> recover.conf
> file as described in the documenation, but I can't seem to write a generic
> shell
> script that will keep the warm-backup in a continously syncronizing
> mode. It
> always stops and renames the recover.conf to recover.done.
>
> I've tried to write an alternate restore command as follows:
>
> #!/usr/local/bin/bash
> if [ -e /export/raid/pgsql/recovery.stop ]; then
> exit 1
> fi
> if [ -e $1 ]; then
> `/bin/cp $1 $2`
> fi
> sleep 5
> exit 0
>
> The documenation says that it should return 0 only if it is
> successfull. My
> understanding is that the recovery script should continuously try to copy
> the
> archived data to the WAL directory so that the WARM-BACKUP server can
> syncronize. I'd like to have the WARM-BACKUP always be only a few minutes
> behind in syncronization from the PRIMARY without human intervention. I can
> write a cronjob to clean out the WAL archive directory accordingly.
>
> I would be extremely gratefull for any assistance from anyone with a
> similar
> configuration. I must be confused by how the restore_command is supposed
> to
> work.
>
>
>
>
> Why don't you just use pg_standby from contrib.
>
> Regards
>
> MP
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2007-08-24 22:05 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2007-08-23 23:54 Warm-Backup configuration question Kenji Morishige <kenjim@juniper.net>
2007-08-24 01:54 ` Tom Arthurs <tarthurs@jobflash.com>
2007-08-24 04:18 ` Mikko Partio <mpartio@gmail.com>
2007-08-24 22:05 ` Kenji Morishige <kenjim@juniper.net>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox