pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Joe Maldonado <jmaldonado@webehosting.biz>
To: pgsql-admin@postgresql.org
Subject: Performance tuning for copy in
Date: Wed, 14 Apr 2004 10:54:22 -0400
Message-ID: <1081954461.3941.17.camel@joem> (raw)

Hello,
Currently I can get no more than 40k records/second to be copied
in to postgres.  This is also the case when running multiple
cocurrent copy in commands from different connections.  It
seems linear in that 1 process will copy in at 40k/s and 2
will copy in at about 20k/s, etc.

I need to know whether I can get better performance from
the db with the hardware specified below.  Changing from
mirrored to stripe RAID is not an option :( at this time
as is turning off fsync (which did not work much better).


-Joe Maldonado

Configuration:
PostgreSQL 7.4 
configure --libdir=/usr/lib \
          --includedir=/usr/include \
          --bindir=/usr/bin \
          --with-krb5=/usr/kerberos \
          --with-openssl=/usr \
          --enable-thread-safety \
          --enable-debug

OS: RedHat 9
Drive Config:
sdb1: /pg_clog
sdb2: /pg_xlog
sdc1: /pg_data (RAID 1)

hdparm output shows average of 45MB/s
iostat shows fairly constant 10MB/s written to pg_data
and 5-8MB/s to WAL.

CPU: 2x 2.0G Xeon





Message-ID: <1081954461.3941.17.camel@joem>
Permalink:  ../1081954461.3941.17.camel@joem/
Also on:    postgresql.org/message-id/1081954461.3941.17.camel@joem

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: jmaldonado@webehosting.biz
  Subject: Re: Performance tuning for copy in
  In-Reply-To: <1081954461.3941.17.camel@joem>
  References: <1081954461.3941.17.camel@joem>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox