pg.ddx.io pgsql-performance@postgresql.org mailing list archivehelp / color / mirror / Atom feed
From: J. Andrew Rogers <jrogers@neopolitan.com>
To: pgsql-performance@postgresql.org
Subject: Re: Insertion puzzles
Date: 16 Nov 2004 11:43:38 -0800
Message-ID: <1100633534.26741.28.camel@vulture.corp.neopolitan.com> (raw)
In-Reply-To: <102570-22004110142048396@M2W072.mail2web.com>
References: <102570-22004110142048396@M2W072.mail2web.com>
On Sat, 2004-11-13 at 18:00, dentfirst13@earthlink.net wrote:
> I ran into the exact same problem you did. I tried many, many changes to
> the conf file, I tried O.S. tuning but performance stunk. I had a fairly
> simple job that had a lot of updates and inserts that was taking 4 1/2
> hours. I re-wrote it to be more "Postgres friendly" - meaning less
> database updates and got it down under 2 1/2 hours (still horrible).
> Understand, the legacy non-postgres ISAM db took about 15 minutes to
> perform the same task. I assumed it was a system problem that would go
> away when we upgraded servers but it did not. I converted to MySQL and the
> exact same java process takes 5 minutes! Postgres is a great DB for some,
> for our application it was not - you may want to consider other products
> that are a bit faster and do not require the vacuuming of stale data.
I have to wonder if the difference is in how your job is being chopped
up by the different connection mechanisms. The only time I've had
performance problems like this, it was the result of pathological and
unwelcome behaviors in the way things were being handled in the
connector or database design.
We have a 15GB OLTP/OLAP database on five spindles with a large
insert/update load and >100M rows, and I don't think it takes 2.5 hours
to do *anything*. This includes inserts/updates of hundreds of
thousands of rows at a shot, which takes very little time.
I've gotten really bad performance before under postgres, but once I
isolated the reason I've always gotten performance that was comparable
to any other commercial RDBMS on the same hardware.
J. Andrew Rogers
view thread (8+ messages)
Message-ID: <1100633534.26741.28.camel@vulture.corp.neopolitan.com> Permalink: ../1100633534.26741.28.camel@vulture.corp.neopolitan.com/ Also on: postgresql.org/message-id/1100633534.26741.28.camel@vulture.corp.neopolitan.com ·
reply
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Reply to all the recipients using the --to and --cc options: reply via email To: pgsql-performance@postgresql.org Cc: jrogers@neopolitan.com Subject: Re: Insertion puzzles In-Reply-To: <1100633534.26741.28.camel@vulture.corp.neopolitan.com> * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions for how to clone and mirror all data and code used for this inbox