From: dentfirst13@earthlink.net <dentfirst13@earthlink.net>
To: sing_vivek@yahoo.com
To: pgsql-performance@postgresql.org
Subject: Re: Insertion puzzles
Date: Sat, 13 Nov 2004 21:00:48 -0500
Message-ID: <102570-22004110142048396@M2W072.mail2web.com> (raw)
Vivek,
I ran into the exact same problem you did. I tried many, many changes to
the conf file, I tried O.S. tuning but performance stunk. I had a fairly
simple job that had a lot of updates and inserts that was taking 4 1/2
hours. I re-wrote it to be more "Postgres friendly" - meaning less
database updates and got it down under 2 1/2 hours (still horrible).
Understand, the legacy non-postgres ISAM db took about 15 minutes to
perform the same task. I assumed it was a system problem that would go
away when we upgraded servers but it did not. I converted to MySQL and the
exact same java process takes 5 minutes! Postgres is a great DB for some,
for our application it was not - you may want to consider other products
that are a bit faster and do not require the vacuuming of stale data.
Original Message:
-----------------
From: vivek singh sing_vivek@yahoo.com
Date: Sat, 13 Nov 2004 03:26:09 -0800 (PST)
To: pgsql-performance@postgresql.org
Subject: [PERFORM] Insertion puzzles
Hello to all,
I am new to this group and postgresql. I am working on
a project which uses postgresql and project is time
critical. We did all optimization in our project but
postgresql seems to be a bottle-neck. To solve this we
run the database operations in a different thread. But
still, with large volume of data in database the
insert operation becomes very slow (ie. to insert 100
records in 5 tables, it takes nearly 3minutes).
vacuum analyze helps a bit but performance improvement
is not much.
We are using the default postgres setting (ie. didn't
change postgresql.conf).
One more point: When we try to upload a pg_dump of
nearly 60K records for 7 tables it took more than
10hrs.
System config:
Redhat Linux7.2
RAM: 256MB
postgres: 7.1.3
connection: ODBC
Thanks to all, please consider it even if it is silly
doubt.
Vivek
__________________________________
Do you Yahoo!?
Check out the new Yahoo! Front Page.
www.yahoo.com
---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org
--------------------------------------------------------------------
mail2web - Check your email from the web at
http://mail2web.com/ .
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: dentfirst13@earthlink.net, sing_vivek@yahoo.com
Subject: Re: Insertion puzzles
In-Reply-To: <102570-22004110142048396@M2W072.mail2web.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox