pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jie Liang <jliang@ipinc.com>
To: Webb Sprague <wsprague100@yahoo.com>
Cc: pgsql-sql@postgresql.org
Subject: Re: Optimizing huge inserts/copy's
Date: Tue, 29 Aug 2000 18:39:50 -0700
Message-ID: <39AC65E6.851BBC64@ipinc.com> (raw)
References: <20000830000452.2110.qmail@web802.mail.yahoo.com>

Hi, there,

1. use copy ... from '.....';
2. write a PL/pgSQL function and pass multiple records as an array.

However, if your table have a foreign key constraint, it cannot be speed
up,

I have same question as you, my table invloving 9-13 million rows, I
don't
know how can I add a foreign key them also?



Webb Sprague wrote:

> Hi all,
>
> Does anybody have any thoughts on optimizing a huge
> insert, involving something like 3 million records all
> at once?  Should I drop my indices before doing the
> copy, and then create them after?  I keep a
> tab-delimited file as a buffer, copy it, then do it
> again about 400 times.  Each separate buffer is a few
> thousand records.
>
> We do this at night, so it's not the end of the world
> if it takes 8 hours, but I would be very grateful for
> some good ideas...
>
> Thanks
> W
>
> __________________________________________________
> Do You Yahoo!?
> Yahoo! Mail - Free email you can access from anywhere!
> http://mail.yahoo.com/

--
Jie LIANG

Internet Products Inc.

10350 Science Center Drive
Suite 100, San Diego, CA 92121
Office:(858)320-4873

jliang@ipinc.com
www.ipinc.com






view thread (9+ messages)  latest in thread

Message-ID: <39AC65E6.851BBC64@ipinc.com>
Permalink:  ../39AC65E6.851BBC64@ipinc.com/
Also on:    postgresql.org/message-id/39AC65E6.851BBC64@ipinc.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: jliang@ipinc.com, wsprague100@yahoo.com
  Subject: Re: Optimizing huge inserts/copy's
  In-Reply-To: <39AC65E6.851BBC64@ipinc.com>
  References: <20000830000452.2110.qmail@web802.mail.yahoo.com> <39AC65E6.851BBC64@ipinc.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox