From: Tom Lane <tgl@sss.pgh.pa.us>
To: Frank Morton <fmorton@base2inc.com>
Cc: pgsql-sql@postgreSQL.org
Subject: Re: [SQL] Slow Inserts Leads To Unable To Dump
Date: Mon, 10 May 1999 12:58:07 -0400
Message-ID: <7801.926355487@sss.pgh.pa.us> (raw)
In-Reply-To: <041c01be9ae7$668ea5a0$8355e5ce@base2inc.com>
"Frank Morton" <fmorton@base2inc.com> writes:
> Now that that is done, I thought I should dump the database
> before doing any more to save those 7 days if I mess up.
> After processing 18 HOURS doing the "pg_dump -d", it ran
> out of memory and quit. Are there tools to do this differently,
Yes: pg_dump without -d. COPY should work fine.
This does suggest an item for the to-do list: making pg_dump use
DECLARE CURSOR and FETCH rather than a plain SELECT to pull the
contents of tables in -d mode. However, if your table is so large
that it doesn't fit in memory inside pg_dump, then I'd have to say
that you wouldn't want to reload it from a series of INSERT statements
anyway. So I'm not very excited about this...
It does seem that your installation is remarkably slow; other people
are working with tables exceeding 2Gb and don't seem unhappy about
the speed. Perhaps you need to check to see if the thing is thrashing;
how much real memory do you have, and what -B setting are you using?
regards, tom lane
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-sql@postgresql.org
Cc: tgl@sss.pgh.pa.us, fmorton@base2inc.com
Subject: Re: [SQL] Slow Inserts Leads To Unable To Dump
In-Reply-To: <7801.926355487@sss.pgh.pa.us>
References: <041c01be9ae7$668ea5a0$8355e5ce@base2inc.com> <7801.926355487@sss.pgh.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox