From: Arnau <arnaulist@andromeiberica.com>
To: pgsql-admin@postgresql.org
Subject: Re: Problems restoring big tables
Date: Mon, 08 Jan 2007 10:41:32 +0100
Message-ID: <45A211CC.80003@andromeiberica.com> (raw)
In-Reply-To: <25554.1168052565@sss.pgh.pa.us>
References: <459E7D83.3030307@andromeiberica.com>
<25554.1168052565@sss.pgh.pa.us>
Hi all,
>> I have to restore a database that its dump using custom format (-Fc)
>> takes about 2.3GB. To speed the restore first I have restored everything
>> except (played with pg_restore -l) the contents of some tables that's
>> where most of the data is stored.
>
> I think you've outsmarted yourself by creating indexes and foreign keys
> before loading the data. That's *not* the way to make it faster.
I made a mistake saying that I wanted to speed the restore. What I
really meant is the following. I have to migrated that DB from a server
to another, that means I have to stop my production environment. Those
big tables are not really needed to be on production as they are only
statistical data. So what I wanted to do is first of all restore the
important tables and at the end restore the statistics.
So what's the way to do this?
>
>> pg_restore: ERROR: out of memory
>> DETAIL: Failed on request of size 32.
>> CONTEXT: COPY statistics_operators, line 25663678: "137320348 58618027
>
> I'm betting you ran out of memory for deferred-trigger event records.
> It's best to load the data and then establish foreign keys ... indexes
> too. See
> http://www.postgresql.org/docs/8.2/static/populate.html
> for some of the underlying theory. (Note that pg_dump/pg_restore
> gets most of this stuff right already; it's unlikely that you will
> improve matters by manually fiddling with the load order. Instead,
> think about increasing maintenance_work_mem and checkpoint_segments,
> which pg_restore doesn't risk fooling with.)
Thank you very much
--
Arnau
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: arnaulist@andromeiberica.com
Subject: Re: Problems restoring big tables
In-Reply-To: <45A211CC.80003@andromeiberica.com>
References: <459E7D83.3030307@andromeiberica.com> <25554.1168052565@sss.pgh.pa.us> <45A211CC.80003@andromeiberica.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox