pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: dentfirst13@earthlink.net <dentfirst13@earthlink.net>
To: sing_vivek@yahoo.com
To: pgsql-performance@postgresql.org
Subject: Re: Insertion puzzles
Date: Sat, 13 Nov 2004 21:00:48 -0500
Message-ID: <102570-22004110142048396@M2W072.mail2web.com> (raw)

Vivek,

I ran into the exact same problem you did.  I tried many, many changes to
the conf file, I tried O.S. tuning but performance stunk.  I had a fairly
simple job that had a lot of updates and inserts that was taking 4 1/2
hours.  I re-wrote it to be more "Postgres friendly" - meaning less
database updates  and got it down under 2 1/2 hours (still horrible). 
Understand, the legacy non-postgres ISAM db took about 15 minutes to
perform the same task.  I assumed it was a system problem that would go
away when we upgraded servers but it did not.  I converted to MySQL and the
exact same java process takes 5  minutes! Postgres is a great DB for some,
for our application it was not - you may want to consider other products
that are a bit faster and do not require the vacuuming of stale data.

Original Message:
-----------------
From: vivek singh sing_vivek@yahoo.com
Date: Sat, 13 Nov 2004 03:26:09 -0800 (PST)
To: pgsql-performance@postgresql.org
Subject: [PERFORM] Insertion puzzles


Hello to all,

I am new to this group and postgresql. I am working on
a project which uses postgresql and project is time
critical. We did all optimization in our project but
postgresql seems to be a bottle-neck. To solve this we
run the database operations in a different thread. But
still, with large volume of data in database the
insert operation becomes very slow (ie. to insert 100
records in 5 tables, it takes nearly 3minutes).

vacuum analyze helps a bit but performance improvement
is not much.
We are using the default postgres setting (ie. didn't
change postgresql.conf).

One more point: When we try to upload a pg_dump of
nearly 60K records for 7 tables it took more than
10hrs. 

System config:

Redhat Linux7.2
RAM: 256MB
postgres: 7.1.3
connection: ODBC

Thanks to all, please consider it even if it is silly
doubt. 
 
Vivek




		
__________________________________ 
Do you Yahoo!? 
Check out the new Yahoo! Front Page. 
www.yahoo.com 
 


---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

--------------------------------------------------------------------
mail2web - Check your email from the web at
http://mail2web.com/ .





view thread (8+ messages)  latest in thread

Message-ID: <102570-22004110142048396@M2W072.mail2web.com>
Permalink:  ../102570-22004110142048396@M2W072.mail2web.com/
Also on:    postgresql.org/message-id/102570-22004110142048396@M2W072.mail2web.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: dentfirst13@earthlink.net, sing_vivek@yahoo.com
  Subject: Re: Insertion puzzles
  In-Reply-To: <102570-22004110142048396@M2W072.mail2web.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox