From: Andrew Sullivan <andrew@libertyrms.info>
To: pgsql-performance@postgresql.org
Subject: Re: Really bad insert performance: what did I do wrong?
Date: Fri, 21 Feb 2003 11:59:17 -0500
Message-ID: <20030221115917.A16866@mail.libertyrms.com> (raw)
In-Reply-To: <3E564695.7030906@digital-ics.com>
References: <3E564695.7030906@digital-ics.com>
On Fri, Feb 21, 2003 at 10:32:37AM -0500, Kevin White wrote:
> I've use PostgreSQL for some pretty amazing things, and was a proponent
> of using it here. I set up 7.3.1 on my development RedHat 8 box, and it
> was fine. I need to load about 700,000 rows into one table, the rows
> only having 6 columns, and the load on my box happens in just a couple
> of minutes (there's some calculation while the data is loading, and that
> time was acceptable to me).
>
> My box, however, isn't a production server, so I attempted to create the
> database again on a Sun Blade:
>
> SunOS trident 5.8 Generic_108528-17 sun4u sparc SUNW,UltraAX-i2
> Status of processor 0 as of: 02/21/03 10:10:10
> Processor has been on-line since 01/13/03 13:53:51.
> The sparcv9 processor operates at 500 MHz,
> and has a sparcv9 floating point processor.
>
> It isn't the world's fastest box, but should be fast enough for this.
What's the disk subsystem? Is fsync turned on in both cases? And is
your IDE drive lying to you about what it's doing.
My experiences in moving from a Linux box to a low-end Sun is pretty
similar. The problem usually turns out to be a combination of
overhead on fsync (which shows up as processor load instead of i/o,
oddly); and memory contention, especially in case there are too-large
numbers of shared buffers (on a 16 Gig box, we find that 2 Gig of
shared buffers is too large -- the shared memory management is
crummy).
A
--
----
Andrew Sullivan 204-4141 Yonge Street
Liberty RMS Toronto, Ontario Canada
<andrew@libertyrms.info> M2P 2A8
+1 416 646 3304 x110
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-performance@postgresql.org
Cc: andrew@libertyrms.info
Subject: Re: Really bad insert performance: what did I do wrong?
In-Reply-To: <20030221115917.A16866@mail.libertyrms.com>
References: <3E564695.7030906@digital-ics.com> <20030221115917.A16866@mail.libertyrms.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox