pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Christopher Petrilli <petrilli@gmail.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: jd@commandprompt.com, "Marc G. Fournier" <scrappy@postgresql.org>
Cc: pgsql-performance@postgresql.org
Subject: Re: Sustained inserts per sec ... ?
Date: Mon, 4 Apr 2005 12:51:17 -0400
Message-ID: <59d991c4050404095114ff953c@mail.gmail.com> (raw)
In-Reply-To: <26669.1112631807@sss.pgh.pa.us>
References: <20050401140421.P18194@ganymede.hub.org>
	<59d991c4050401113857086517@mail.gmail.com>
	<28353.1112388128@sss.pgh.pa.us>
	<59d991c4050401124638c4ab5d@mail.gmail.com>
	<1112388818.3487.34.camel@jd2.commandprompt.com>
	<59d991c4050401125956d6069d@mail.gmail.com>
	<59d991c40504040648457808e9@mail.gmail.com>
	<26454.1112629979@sss.pgh.pa.us>
	<59d991c405040409094e7bbd17@mail.gmail.com>
	<26669.1112631807@sss.pgh.pa.us>

On Apr 4, 2005 12:23 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> Christopher Petrilli <petrilli@gmail.com> writes:
> > On Apr 4, 2005 11:52 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> >> Could we see the *exact* SQL definitions of the table and indexes?
> 
> > Of course, this is a bit cleansed, since it's an internal project, but
> > only the column names are changed:
> 
> Thanks.  No smoking gun in sight there.  But out of curiosity, can you
> do a test run with *no* indexes on the table, just to see if it behaves
> any differently?  Basically I was wondering if index overhead might be
> part of the problem.

Running now, but it'll take a while since I have a 3/4 second pause
after each COPY to better reflect "real world" ... the application
does 1 COPY per second, or whenever it hits 1000 entries. This seemed
to be a sane way to deal with it, and not burden the system with
needless index balancing, etc.

> Also, the X-axis on your graphs seems to be total number of rows
> inserted ... can you relate that to elapsed real time for us?

Sure, like I said, there's a 3/4 second sleep between each COPY,
regardless of how long it took (which well, isn't quite right, but
close enough for this test).  I've created a PNG with the X axies
reflecting "elapsed time":

http://www.amber.org/~petrilli/diagrams/pgsql_copyperf_timeline.png

In addition, I've put up the raw data I used:

http://www.amber.org/~petrilli/diagrams/results_timeline.txt

The columns are rowcount, elapsed time, instance time.
Hopefully this might help some?  This machine has nothing else running
on it other than the normal stripped down background processes (like
sshd).

-- 
| Christopher Petrilli
| petrilli@gmail.com



view thread (44+ messages)  latest in thread

Message-ID: <59d991c4050404095114ff953c@mail.gmail.com>
Permalink:  ../59d991c4050404095114ff953c@mail.gmail.com/
Also on:    postgresql.org/message-id/59d991c4050404095114ff953c@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: petrilli@gmail.com, tgl@sss.pgh.pa.us, scrappy@postgresql.org
  Subject: Re: Sustained inserts per sec ... ?
  In-Reply-To: <59d991c4050404095114ff953c@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox