pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Worky Workerson <worky.workerson@gmail.com>
To: Luke Lonergan <llonergan@greenplum.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Best COPY Performance
Date: Fri, 27 Oct 2006 15:08:32 -0400
Message-ID: <ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com> (raw)
In-Reply-To: <C1651375.523A%llonergan@greenplum.com>
References: <ce4072df0610251126w1eaca026x7751256f962b131f@mail.gmail.com>
	<C1651375.523A%llonergan@greenplum.com>

> The read speed on your /data volume is awful to the point where you should
> consider it broken and find a fix.  A quick comparison: the same number on a
> 16 drive internal SATA array with 7200 RPM disks gets 950 MB/s read, about
> 25 times faster for about 1/4 the price.

I'm hoping that the poor performance is a result of Oracle doing
random reads while I try and do the sequential read.  If not (I'll
test on Monday), I'll start looking other places.  Any immediate
suggestions?

> Can you provide about 10 seconds worth of "vmstat 1" while running your COPY
> so we can get a global view of the I/O and CPU?

Here it is, taken from a spot about halfway through a 'cat file |
psql' load, with the "Oracle-is-installed-and-running" caveat:

r b   swpd  free   buff    cache si so bi    bo   in   cs us sy id wa
1 0 345732 29328 770980 12947212  0  0 20 16552 1223 3677 12  2 85  1
1 0 345732 29840 770520 12946924  0  0 20 29244 1283 2955 11  2 85  1
1 0 345732 32144 770560 12944436  0  0 12 16436 1204 2936 11  2 86  1
1 0 345732 33744 770464 12942764  0  0 20 16460 1189 2005 10  2 86  1
2 0 345732 32656 770140 12943972  0  0 16  7068 1057 3434 13  2 85  0
1 0 345732 34832 770184 12941820  0  0 20  9368 1170 3120 11  2 86  1
1 0 345732 36528 770228 12939804  0  0 16 32668 1297 2109 11  2 85  1
1 0 345732 29304 770272 12946764  0  0 16 16428 1192 3105 12  2 85  1
1 0 345732 30840 770060 12945480  0  0 20 16456 1196 3151 12  2 84  1
1 0 345732 32760 769972 12943528  0  0 12 16460 1185 3103 11  2 86  1



view thread (52+ messages)  latest in thread

Message-ID: <ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com>
Permalink:  ../ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com/
Also on:    postgresql.org/message-id/ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-performance@postgresql.org
  Cc: worky.workerson@gmail.com, llonergan@greenplum.com
  Subject: Re: Best COPY Performance
  In-Reply-To: <ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com>
  References: <ce4072df0610251126w1eaca026x7751256f962b131f@mail.gmail.com> <C1651375.523A%llonergan@greenplum.com> <ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox