pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Simon Riggs <simon@2ndquadrant.com>
To: Brendan Duddridge <brendan@clickspace.com>
Cc: PostgreSQL Performance <pgsql-performance@postgresql.org>
Subject: Re: Recovery will take 10 hours
Date: Sun, 23 Apr 2006 17:06:07 +0100
Message-ID: <1145808368.3112.222.camel@localhost.localdomain> (raw)
In-Reply-To: <85A15B2E-F59C-4FEF-82D4-61F48ABDCDE5@clickspace.com>
References: <85A15B2E-F59C-4FEF-82D4-61F48ABDCDE5@clickspace.com>

On Thu, 2006-04-20 at 13:29 -0600, Brendan Duddridge wrote:

> We had a database issue today that caused us to have to restore to  
> our most recent backup. We are using PITR so we have 3120 WAL files  
> that need to be applied to the database.

How often are you taking base backups?

> After 45 minutes, it has restored only 230 WAL files. At this rate,  
> it's going to take about 10 hours to restore our database.

> Most of the time, the server is not using very much CPU time or I/O  
> time. So I'm wondering what can be done to speed up the process?

You can improve the performance of a recovery by making your restore
command overlap retrieval of files. The recovery process waits while the
restore command returns a file, so by doing an asynchronous lookahead of
one file you can be gunzipping the next file while the current one is
being processed.

I'll either document this better, or build an overlap into the restore
command processing itself, so the script doesn't need to do this.

-- 
  Simon Riggs
  EnterpriseDB          http://www.enterprisedb.com/




view thread (21+ messages)  latest in thread

Message-ID: <1145808368.3112.222.camel@localhost.localdomain>
Permalink:  ../1145808368.3112.222.camel@localhost.localdomain/
Also on:    postgresql.org/message-id/1145808368.3112.222.camel@localhost.localdomain

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: simon@2ndquadrant.com, brendan@clickspace.com
  Subject: Re: Recovery will take 10 hours
  In-Reply-To: <1145808368.3112.222.camel@localhost.localdomain>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox