pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
BUG #2567: High IOWAIT
4+ messages / 4 participants
[nested] [flat]

* BUG #2567: High IOWAIT
@ 2006-08-08 08:42 kumarselvan <kumar@nexge.com>
  2006-08-09 22:26 ` Re: BUG #2567: High IOWAIT Jim C. Nasby <jnasby@pervasive.com>
  0 siblings, 1 reply; 4+ messages in thread

From: kumarselvan @ 2006-08-08 08:42 UTC (permalink / raw)
  To: pgsql-bugs@postgresql.org


The following bug has been logged online:

Bug reference:      2567
Logged by:          kumarselvan
Email address:      kumar@nexge.com
PostgreSQL version: 8.1
Operating system:   Linux Enterprise version 3
Description:        High IOWAIT
Details: 

i have installed the postgres as mentioned in the Install file. it is a 4
cpu 8 GB Ram Machine installed with Linux Enterprise version 3. when i am
running a load which will perfrom 40 inserts persecond on 2 tables and 10
updates per 10seconds on differnt table IOWait on avg going upto 70% due to
which i am not able to increase the load. Is there is any other way to
install the postgres on multiprocessor machine.. can any one help me on
this...



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: BUG #2567: High IOWAIT
  2006-08-08 08:42 BUG #2567: High IOWAIT kumarselvan <kumar@nexge.com>
@ 2006-08-09 22:26 ` Jim C. Nasby <jnasby@pervasive.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Jim C. Nasby @ 2006-08-09 22:26 UTC (permalink / raw)
  To: kumarselvan <kumar@nexge.com>; +Cc: pgsql-performance

This isn't a bug; moving to pgsql-performance.

On Tue, Aug 08, 2006 at 08:42:02AM +0000, kumarselvan wrote:
> i have installed the postgres as mentioned in the Install file. it is a 4
> cpu 8 GB Ram Machine installed with Linux Enterprise version 3. when i am
> running a load which will perfrom 40 inserts persecond on 2 tables and 10
> updates per 10seconds on differnt table IOWait on avg going upto 70% due to
> which i am not able to increase the load. Is there is any other way to
> install the postgres on multiprocessor machine.. can any one help me on
> this...

You haven't given us nearly enough information. What kind of hardware is
this? RAID? What changes have you made to postgresql.conf?
-- 
Jim C. Nasby, Sr. Engineering Consultant      jnasby@pervasive.com
Pervasive Software      http://pervasive.com    work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf       cell: 512-569-9461



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: [BUGS] BUG #2567: High IOWAIT
@ 2006-08-10 16:53 Jim Nasby <jnasby@pervasive.com>
  2006-08-11 08:48 ` Re: [BUGS] BUG #2567: High IOWAIT Markus Schaber <schabi@logix-tt.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Jim Nasby @ 2006-08-10 16:53 UTC (permalink / raw)
  To: Kumarselvan S <kumar@nexge.com>; +Cc: pgsql-performance

Please cc the list so others can help.

How large is the database? What indexes are on the tables you're inserting into? What speed is the drive?

Since it's a single SCSI drive I'm assuming it's only 10k RPM, which means the theoretical maximum you can hit is 160 transfers per second. At 40 inserts per second (I'm assuming each insert is it's own transaction), you're already at 40 WAL operations per second, minimum. Plus whatever traffic you have to the data tables.

Your biggest win would be to batch those inserts together into transactions, if possible. If not, the commit_delay settings might help you out.

There may be some further gains to be had by tweaking the background writer settings; it might be too aggressive in your application.

That update statement could also be causing a lot of activity, depending on what it's doing.
--
Jim C. Nasby, Sr. Engineering Consultant      jnasby@pervasive.com
Pervasive Software      http://pervasive.com    work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf       cell: 512-569-9461



-----Original Message-----
From: Kumarselvan S [mailto:kumar@nexge.com]
Sent: Wed 8/9/2006 11:33 PM
To: Jim Nasby
Subject: RE: [BUGS] BUG #2567: High IOWAIT
 
Yes , it is not a Bug. 
Here the some Info abt the Hardware
It has an SCSI Drive.
It an dell made quad processor machine. 

The changes to Postgresql.conf
1. max_connections =50
2. shared buffer = 30000
3. Temp buffer 20000

Regards,
Kumar
-----Original Message-----
From: Jim C. Nasby [mailto:jnasby@pervasive.com] 
Sent: Thursday, August 10, 2006 3:57 AM
To: kumarselvan
Cc: pgsql-performance@postgresql.org
Subject: Re: [BUGS] BUG #2567: High IOWAIT

This isn't a bug; moving to pgsql-performance.

On Tue, Aug 08, 2006 at 08:42:02AM +0000, kumarselvan wrote:
> i have installed the postgres as mentioned in the Install file. it is a 4
> cpu 8 GB Ram Machine installed with Linux Enterprise version 3. when i am
> running a load which will perfrom 40 inserts persecond on 2 tables and 10
> updates per 10seconds on differnt table IOWait on avg going upto 70% due
to
> which i am not able to increase the load. Is there is any other way to
> install the postgres on multiprocessor machine.. can any one help me on
> this...

You haven't given us nearly enough information. What kind of hardware is
this? RAID? What changes have you made to postgresql.conf?
-- 
Jim C. Nasby, Sr. Engineering Consultant      jnasby@pervasive.com
Pervasive Software      http://pervasive.com    work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf       cell: 512-569-9461


quad






^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: [BUGS] BUG #2567: High IOWAIT
  2006-08-10 16:53 Re: [BUGS] BUG #2567: High IOWAIT Jim Nasby <jnasby@pervasive.com>
@ 2006-08-11 08:48 ` Markus Schaber <schabi@logix-tt.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Markus Schaber @ 2006-08-11 08:48 UTC (permalink / raw)
  To: pgsql-performance; +Cc: Kumarselvan S <kumar@nexge.com>

Hi, Jim,

Jim Nasby wrote:

> Your biggest win would be to batch those inserts together into
> transactions, if possible.

Using COPY instead of INSERT might even give better wins, and AFAIK some
client libs use COPY internally (e. G. tablewriter from libpqxx).

> If not, the commit_delay settings might help you out.

As far as I understand, this will only help for concurrent inserts by
different clients, dealing throughput for latency. Please correct me if
I'm wrong.

HTH,
Markus
-- 
Markus Schaber | Logical Tracking&Tracing International AG
Dipl. Inf.     | Software Development GIS

Fight against software patents in EU! www.ffii.org www.nosoftwarepatents.org



^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2006-08-11 08:48 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-08-08 08:42 BUG #2567: High IOWAIT kumarselvan <kumar@nexge.com>
2006-08-09 22:26 ` Jim C. Nasby <jnasby@pervasive.com>
2006-08-10 16:53 Re: [BUGS] BUG #2567: High IOWAIT Jim Nasby <jnasby@pervasive.com>
2006-08-11 08:48 ` Markus Schaber <schabi@logix-tt.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox