pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Josh Berkus <josh@agliodbs.com>
To: pgsql-performance@postgresql.org
To: grupos@carvalhaes.net
Subject: Re: Improve BULK insertion
Date: Sun, 5 Dec 2004 15:19:45 -0800
Message-ID: <200412051519.45328.josh@agliodbs.com> (raw)
In-Reply-To: <41B366E3.7040109@carvalhaes.net>
References: <41B1BE1B.10301@carvalhaes.net>
	<m38y8ep1ao.fsf@knuth.knuth.cbbrowne.com>
	<41B366E3.7040109@carvalhaes.net>

Rodrigo,

> 3. My transaction log configuration are : checkpoint_segments = 3  and
> checkpoint_timeout = 300 and my transaction logs are on the same disk .

Well, you need to move your transaction logs to another disk, and increase 
them to a large number ... like 128, which is about 1GB (you'll need that 
much disk space).   Also, increase the checkpoint_timeout to minimize 
checkpointing during the load; like, 1500.

> I know that I can increase the performance separating the transaction
> logs and making a RAID 5 array 

Actually, RAID5, unless you're using > 5 disks, would make things slower.   
Speeding writes up through RAID would require at least 6 drives, and probably 
RAID 1+0.

> BUT I am really curious about WHY this 
> performance is so poor and HOW can I try to improve on this actual
> machine because actualy this inserts are taking around 90 minutes!!!

Are you doing INSERTS and not COPY?   If so, are you batching them in 
transactions?

-- 
Josh Berkus
Aglio Database Solutions
San Francisco



view thread (7+ messages)

Message-ID: <200412051519.45328.josh@agliodbs.com>
Permalink:  ../200412051519.45328.josh@agliodbs.com/
Also on:    postgresql.org/message-id/200412051519.45328.josh@agliodbs.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: josh@agliodbs.com, grupos@carvalhaes.net
  Subject: Re: Improve BULK insertion
  In-Reply-To: <200412051519.45328.josh@agliodbs.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox