X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 47E3F3A4B8C for ; Sun, 14 Nov 2004 02:00:58 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 30929-10 for ; Sun, 14 Nov 2004 02:00:46 +0000 (GMT) Received: from relay1.mail2web.com (relay1.mail2web.com [168.144.1.81]) by svr1.postgresql.org (Postfix) with ESMTP id 47ED83A414D for ; Sun, 14 Nov 2004 02:00:48 +0000 (GMT) Received: from M2W072.mail2web.com ([168.144.251.182]) by relay1.mail2web.com with Microsoft SMTPSVC(5.0.2195.6713); Sat, 13 Nov 2004 21:00:48 -0500 Message-ID: <102570-22004110142048396@M2W072.mail2web.com> X-Priority: 3 Reply-To: dentfirst13@earthlink.net X-Originating-IP: 66.23.218.85 X-URL: http://mail2web.com/ From: "dentfirst13@earthlink.net" To: sing_vivek@yahoo.com, pgsql-performance@postgresql.org Subject: Re: Insertion puzzles Date: Sat, 13 Nov 2004 21:00:48 -0500 MIME-Version: 1.0 Content-type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-OriginalArrivalTime: 14 Nov 2004 02:00:48.0264 (UTC) FILETIME=[C29BD080:01C4C9ED] X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=1.7 tagged_above=0.0 required=5.0 tests=FROM_ENDS_IN_NUMS, PRIORITY_NO_NAME X-Spam-Level: * X-Archive-Number: 200411/218 X-Sequence-Number: 9172 Vivek, I ran into the exact same problem you did=2E I tried many, many changes t= o the conf file, I tried O=2ES=2E tuning but performance stunk=2E I had a f= airly simple job that had a lot of updates and inserts that was taking 4 1/2 hours=2E I re-wrote it to be more "Postgres friendly" - meaning less database updates and got it down under 2 1/2 hours (still horrible)=2E=20= Understand, the legacy non-postgres ISAM db took about 15 minutes to perform the same task=2E I assumed it was a system problem that would go away when we upgraded servers but it did not=2E I converted to MySQL and = the exact same java process takes 5 minutes! Postgres is a great DB for some,= for our application it was not - you may want to consider other products that are a bit faster and do not require the vacuuming of stale data=2E Original Message: ----------------- From: vivek singh sing_vivek@yahoo=2Ecom Date: Sat, 13 Nov 2004 03:26:09 -0800 (PST) To: pgsql-performance@postgresql=2Eorg Subject: [PERFORM] Insertion puzzles Hello to all, I am new to this group and postgresql=2E I am working on a project which uses postgresql and project is time critical=2E We did all optimization in our project but postgresql seems to be a bottle-neck=2E To solve this we run the database operations in a different thread=2E But still, with large volume of data in database the insert operation becomes very slow (ie=2E to insert 100 records in 5 tables, it takes nearly 3minutes)=2E vacuum analyze helps a bit but performance improvement is not much=2E We are using the default postgres setting (ie=2E didn't change postgresql=2Econf)=2E One more point: When we try to upload a pg_dump of nearly 60K records for 7 tables it took more than 10hrs=2E=20 System config: Redhat Linux7=2E2 RAM: 256MB postgres: 7=2E1=2E3 connection: ODBC Thanks to all, please consider it even if it is silly doubt=2E=20 =20 Vivek =09=09 __________________________________=20 Do you Yahoo!?=20 Check out the new Yahoo! Front Page=2E=20 www=2Eyahoo=2Ecom=20 =20 ---------------------------(end of broadcast)--------------------------- TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql=2Eorg= -------------------------------------------------------------------- mail2web - Check your email from the web at http://mail2web=2Ecom/ =2E