pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Toru SHIMOGAKI <shimogaki.toru@oss.ntt.co.jp>
To: Tom Lane <tgl@sss.pgh.pa.us>
To: Dan Gorman <dgorman@hi5.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: PITR Backups
Date: Fri, 22 Jun 2007 11:30:49 +0900
Message-ID: <467B3459.9030808@oss.ntt.co.jp> (raw)
In-Reply-To: <9761.1182472005@sss.pgh.pa.us>
References: <7E0807EE-B970-4869-A248-B838E42AD9EE@hi5.com>
	<9761.1182472005@sss.pgh.pa.us>


Tom Lane wrote:
> Dan Gorman <dgorman@hi5.com> writes:
>>    All of our databases are on NetApp storage and I have been looking  
>> at SnapMirror (PITR RO copy ) and FlexClone (near instant RW volume  
>> replica) for backing up our databases. The problem is because there  
>> is no write-suspend or even a 'hot backup mode' for postgres it's  
>> very plausible that the database has data in RAM that hasn't been  
>> written and will corrupt the data.

> Alternatively, you can use a PITR base backup as suggested here:
> http://www.postgresql.org/docs/8.2/static/continuous-archiving.html

I think Dan's problem is important if we use PostgreSQL to a large size database:

- When we take a PITR base backup with hardware level snapshot operation
  (not filesystem level) which a lot of storage vender provide, the backup data
  can be corrupted as Dan said. During recovery we can't even read it,
  especially if meta-data was corrupted.

- If we don't use hardware level snapshot operation, it takes long time to take
  a large backup data, and a lot of full-page-written WAL files are made.

So, I think users need a new feature not to write out heap pages during taking a
backup.

Any comments?

Best regards,

-- 
Toru SHIMOGAKI<shimogaki.toru@oss.ntt.co.jp>
NTT Open Source Software Center




view thread (38+ messages)  latest in thread

Message-ID: <467B3459.9030808@oss.ntt.co.jp>
Permalink:  ../467B3459.9030808@oss.ntt.co.jp/
Also on:    postgresql.org/message-id/467B3459.9030808@oss.ntt.co.jp

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: shimogaki.toru@oss.ntt.co.jp, tgl@sss.pgh.pa.us, dgorman@hi5.com
  Subject: Re: PITR Backups
  In-Reply-To: <467B3459.9030808@oss.ntt.co.jp>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox