pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Frank Morton <fmorton@base2inc.com>
Cc: pgsql-sql@postgreSQL.org
Subject: Re: [SQL] Slow Inserts Leads To Unable To Dump
Date: Mon, 10 May 1999 12:58:07 -0400
Message-ID: <7801.926355487@sss.pgh.pa.us> (raw)
In-Reply-To: <041c01be9ae7$668ea5a0$8355e5ce@base2inc.com>

"Frank Morton" <fmorton@base2inc.com> writes:
> Now that that is done, I thought I should dump the database
> before doing any more to save those 7 days if I mess up.
> After processing 18 HOURS doing the "pg_dump -d", it ran
> out of memory and quit. Are there tools to do this differently,

Yes: pg_dump without -d.  COPY should work fine.

This does suggest an item for the to-do list: making pg_dump use
DECLARE CURSOR and FETCH rather than a plain SELECT to pull the
contents of tables in -d mode.  However, if your table is so large
that it doesn't fit in memory inside pg_dump, then I'd have to say
that you wouldn't want to reload it from a series of INSERT statements
anyway.  So I'm not very excited about this...

It does seem that your installation is remarkably slow; other people
are working with tables exceeding 2Gb and don't seem unhappy about
the speed.  Perhaps you need to check to see if the thing is thrashing;
how much real memory do you have, and what -B setting are you using?

			regards, tom lane



view thread (3+ messages)  latest in thread

Message-ID: <7801.926355487@sss.pgh.pa.us>
Permalink:  ../7801.926355487@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/7801.926355487@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: tgl@sss.pgh.pa.us, fmorton@base2inc.com
  Subject: Re: [SQL] Slow Inserts Leads To Unable To Dump
  In-Reply-To: <7801.926355487@sss.pgh.pa.us>
  References: <041c01be9ae7$668ea5a0$8355e5ce@base2inc.com> <7801.926355487@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox