pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Stephen Frost <sfrost@snowman.net>
To: Ayush Goyal <ayush@helpshift.com>
Cc: pgsql-admin@postgresql.org
Subject: Re: Using pg hotbackup directly without wal archives
Date: Wed, 26 Oct 2016 09:30:56 -0400
Message-ID: <20161026133056.GB13284@tamriel.snowman.net> (raw)
In-Reply-To: <CA+Pdoy_rU8eqbXBZVKaqun8Q-K0e38QGpy_TiEV6uSW5hYa92Q@mail.gmail.com>
References: <CA+Pdoy_rU8eqbXBZVKaqun8Q-K0e38QGpy_TiEV6uSW5hYa92Q@mail.gmail.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>

Greetings,

* Ayush Goyal (ayush@helpshift.com) wrote:
> I need to ask if there is a way to use the pg hot backup taken via
> pg_start_backup() and pg_stop_backup() calls directly without using the wal
> archives.

No, WAL is required for correct backups.  There are multiple ways to
ensure that the WAL is archived.

> If I start postgres with just base backup without setting up recovery.conf
> for fetching archived wal logs, I get this im the log files:
> 
> 2016-10-26 06:48:25 UTC LOG:  database system was shut down in recovery at
> 2016-10-25 15:50:16 UTC
> 2016-10-26 06:48:25 UTC LOG:  invalid primary checkpoint record
> 2016-10-26 06:48:25 UTC LOG:  invalid secondary checkpoint record
> 2016-10-26 06:48:25 UTC PANIC:  could not locate a valid checkpoint record
> 2016-10-26 06:48:25 UTC LOG:  startup process (PID 980) was terminated by
> signal 6: Aborted
> 2016-10-26 06:48:25 UTC LOG:  aborting startup due to startup process
> failure
> 
> Also, I noticed that if I run pg_resetxlog, I am able to start postgres,
> but I am not  sure if the database is consistent after running
> pg_resetxlog. Is database state consistent after running pg_resetxlog on
> this hot backup?

No, the database state will *not* be consistent after pg_resetxlog.  You
must archive the WAL which is written during the backup and must provide
a recovery.conf when performing a restore.

I strongly recommend that you look at using the existing PG backup tools
which will correctly perform the backup and WAL archiving, such as
pg_basebackup, pgBackRest, or barman.

Thanks!

Stephen

Attachments:

  signature.asc (application/pgp-signature, 818B) download

view thread (2+ messages)

Message-ID: <20161026133056.GB13284@tamriel.snowman.net>
Permalink:  ../20161026133056.GB13284@tamriel.snowman.net/
Also on:    postgresql.org/message-id/20161026133056.GB13284@tamriel.snowman.net

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: sfrost@snowman.net, ayush@helpshift.com
  Subject: Re: Using pg hotbackup directly without wal archives
  In-Reply-To: <20161026133056.GB13284@tamriel.snowman.net>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox