From: Mark Kirkwood <markir@i4free.co.nz>
To: Richard Huxton <dev@archonet.com>
To: edipoelder@ig.com.br
Cc: pgsql-sql@postgresql.org
Subject: Memory And Performance
Date: Sat, 7 Apr 2001 15:31:04 +1200
Message-ID: <01040715310400.00651@spikey.slithery.org> (raw)
> > The system that I'm developing, I have about 25000 (persons) x 8
>>(exams)
>> x 15 (answers per exam) = 3000000 records to process and it is VERY SLOW.
>
>f you need to import large quantities of data, look at the copy
>command, that tends to be faster.
By way of example for the level of improvement COPY gives:
a 3000000 row table ( 350Mb dump file -> 450Mb table ) can by loaded via copy
in 7 minutes. To insert each row (say using a perl prog to read the file and
DBD-Pg to insert, committing every 10000 rows ) takes about 75minutes. I used
a PII 266Mhz/192Mb and Postgresql 7.1b5 for these results. Postgresql 7.0.2
is slower ( 20-30% or so...), but should still display a similar level of
improvement with copy.
Good loading
Mark
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-sql@postgresql.org
Cc: markir@i4free.co.nz, dev@archonet.com, edipoelder@ig.com.br
Subject: Re: Memory And Performance
In-Reply-To: <01040715310400.00651@spikey.slithery.org>
References: <01040715310400.00651@spikey.slithery.org>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox