From: adrien ducos <aducos@hbs-research.com>
To: Viktor Bojović <viktor.bojovic@gmail.com>
Cc: pgsql-admin@postgresql.org <pgsql-admin@postgresql.org>
Subject: Re: db restore takes to long
Date: Mon, 09 May 2011 14:03:13 +0200
Message-ID: <4DC7D801.3070607@hbs-research.com> (raw)
In-Reply-To: <BANLkTik2Ni8NDotj7KgsXvBwEZGEXFTSEA@mail.gmail.com>
References: <BANLkTimSYrirVHhMCpqMkEhxjKBz4Cyo+Q@mail.gmail.com>
<4DC7BFB2.7080106@hbs-research.com>
<BANLkTik2Ni8NDotj7KgsXvBwEZGEXFTSEA@mail.gmail.com>
If the indexes are the issue, you can also try to increase the
maintenance_work_mem during the restore and put it back again as normal
afterwards.
That is what the postgres documentation says about it:
maintenance_work_mem (integer)
Specifies the maximum amount of memory to be used in maintenance
operations, such as VACUUM, CREATE INDEX, and ALTER TABLE ADD
FOREIGN KEY. It defaults to 16 megabytes (16MB). Since only one of
these operations can be executed at a time by a database session,
and an installation normally doesn't have many of them running
concurrently, it's safe to set this value significantly larger than
work_mem. Larger settings might improve performance for vacuuming
and for restoring database dumps.
Note that when autovacuum runs, up to autovacuum_max_workers
<http://www.postgresql.org/docs/8.3/static/runtime-config-autovacuum.html#GUC-AUTOVACUUM-MAX-WORKERS;
times this memory may be allocated, so be careful not to set the
default value too high.
Viktor Bojović a écrit :
> Thanx Adrien,
> i have tried to skip indexes but constraints rely on them
> "there is no unique constraint matching given keys for referenced table"
> , so i will try to use pg_restore as you have mentioned below.
>
> On Mon, May 9, 2011 at 12:19 PM, adrien ducos <aducos@hbs-research.com
> <mailto:aducos@hbs-research.com>> wrote:
>
> It seams there is no option like that in pg_dump or pg_restore.
> But You can manualy do it in the dump or with a sed command
> finding the lines begining by CREATE INDEX and removing them.
>
> We also have a big database and since postgres 8.4 pg_restore is
> much faster with the option --jobs=x
>
> where x is the number of cores you have in your microprocessor. It
> then divides the restore script into different jobs and goes
> faster using multithreading.
> example:
> pg_restore --username postgres --jobs=4 --dbname=your_db_name
> your_dump_file
>
> Here is if you have a quad core.
>
> Adrien
>
>
> Viktor Bojović a écrit :
>
> Hi,
>
> im trying to restore 250GB database, but indexing takes too
> long, so restore takes more then 12h.
> Is it possible to disable indexing while restoring database?
>
> Thanx in advance
>
>
> --
> ---------------------------------------
> Viktor Bojović
> ---------------------------------------
> Wherever I go, Murphy goes with me
>
>
>
> --
>
> Logo_HBS_mail.jpg
> Adrien DUCOS
> Analyste développeur
> aducos@hbs-research.com <mailto:aducos@hbs-research.com>
> <mailto:aducos@hbs-research.com <mailto:aducos@hbs-research.com>>
> www.hbs-research.com <http://www.hbs-research.com;
> <http://www.hbs-research.com/;
> +33 (0)9 70 44 64 10
> 24 rue de l'Est
> 75020 Paris
>
>
>
>
>
>
> --
> ---------------------------------------
> Viktor Bojović
> ---------------------------------------
> Wherever I go, Murphy goes with me
--
Logo_HBS_mail.jpg
Adrien DUCOS
Analyste développeur
aducos@hbs-research.com <mailto:aducos@hbs-research.com>
www.hbs-research.com <http://www.hbs-research.com/;
+33 (0)9 70 44 64 10
24 rue de l'Est
75020 Paris
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: aducos@hbs-research.com, viktor.bojovic@gmail.com
Subject: Re: db restore takes to long
In-Reply-To: <4DC7D801.3070607@hbs-research.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox