From: Joe Maldonado <jmaldonado@webehosting.biz>
To: pgsql-admin@postgresql.org
Subject: Performance tuning for copy in
Date: Wed, 14 Apr 2004 10:54:22 -0400
Message-ID: <1081954461.3941.17.camel@joem> (raw)
Hello,
Currently I can get no more than 40k records/second to be copied
in to postgres. This is also the case when running multiple
cocurrent copy in commands from different connections. It
seems linear in that 1 process will copy in at 40k/s and 2
will copy in at about 20k/s, etc.
I need to know whether I can get better performance from
the db with the hardware specified below. Changing from
mirrored to stripe RAID is not an option :( at this time
as is turning off fsync (which did not work much better).
-Joe Maldonado
Configuration:
PostgreSQL 7.4
configure --libdir=/usr/lib \
--includedir=/usr/include \
--bindir=/usr/bin \
--with-krb5=/usr/kerberos \
--with-openssl=/usr \
--enable-thread-safety \
--enable-debug
OS: RedHat 9
Drive Config:
sdb1: /pg_clog
sdb2: /pg_xlog
sdc1: /pg_data (RAID 1)
hdparm output shows average of 45MB/s
iostat shows fairly constant 10MB/s written to pg_data
and 5-8MB/s to WAL.
CPU: 2x 2.0G Xeon
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: jmaldonado@webehosting.biz
Subject: Re: Performance tuning for copy in
In-Reply-To: <1081954461.3941.17.camel@joem>
References: <1081954461.3941.17.camel@joem>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox