From: Worky Workerson <worky.workerson@gmail.com>
To: Merlin Moncure <mmoncure@gmail.com>
Cc: Markus Schaber <schabi@logix-tt.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Best COPY Performance
Date: Wed, 25 Oct 2006 11:25:01 -0400
Message-ID: <ce4072df0610250825h324d30datece27c0c541162ff@mail.gmail.com> (raw)
In-Reply-To: <b42b73150610250620r37cf9269m7b6e43b9835bdbcf@mail.gmail.com>
References: <ce4072df0610201305u7836dc7bn437ec0aaf1c3e25f@mail.gmail.com>
<453C8B0D.4070803@logix-tt.com>
<ce4072df0610230840r4b3df653h3144dab06bdb9ed2@mail.gmail.com>
<b42b73150610250620r37cf9269m7b6e43b9835bdbcf@mail.gmail.com>
> I'm guessing the high bursts are checkpoints. Can you check your log
> files for pg and see if you are getting warnings about checkpoint
> frequency? You can get some mileage here by increasing wal files.
Nope, nothing in the log. I have set:
wal_buffers=128
checkpoint_segments=128
checkpoint_timeout=3000
which I thought was rather generous. Perhaps I should set it even
higher for the loads?
> Have you determined that pg is not swapping? try upping maintenance_work_mem.
maintenance_work_mem = 524288 ... should I increase it even more?
Doesn't look like pg is swapping ...
> What exactly is your architecture? is your database server direct
> attached to the san? if so, 2gb/4gb fc? what san? have you bonnie++
> the san? basically, you can measure iowait to see if pg is waiting on
> your disks.
I'm currently running bonnie++ with the defaults ... should I change
the execution to better mimic Postgres' behavior?
RHEL 4.3 x86_64
HP DL585, 4 Dual Core Opteron 885s
16 GB RAM
2x300GB 10K SCSI320, RAID10
HP MSA1000 SAN direct connected via single 2GB Fibre Channel Arbitrated Loop
10x300GB 10K SCSI320, RAID10
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: worky.workerson@gmail.com, mmoncure@gmail.com, schabi@logix-tt.com
Subject: Re: Best COPY Performance
In-Reply-To: <ce4072df0610250825h324d30datece27c0c541162ff@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox