From: Simon Riggs <simon@2ndquadrant.com>
To: Christopher Petrilli <petrilli@gmail.com>
Cc: jd@commandprompt.com, Tom Lane <tgl@sss.pgh.pa.us>
Cc: Marc G. Fournier <scrappy@postgresql.org>
Cc: pgsql-performance@postgresql.org
Subject: Re: Sustained inserts per sec ... ?
Date: Mon, 04 Apr 2005 21:58:23 +0100
Message-ID: <1112648303.16721.816.camel@localhost.localdomain> (raw)
In-Reply-To: <59d991c405040413184699cfe1@mail.gmail.com>
References: <20050401140421.P18194@ganymede.hub.org>
<59d991c4050401113857086517@mail.gmail.com>
<28353.1112388128@sss.pgh.pa.us>
<59d991c4050401124638c4ab5d@mail.gmail.com>
<1112388818.3487.34.camel@jd2.commandprompt.com>
<59d991c4050401125956d6069d@mail.gmail.com>
<59d991c40504040648457808e9@mail.gmail.com>
<1112644015.16721.790.camel@localhost.localdomain>
<59d991c4050404125611ad5af8@mail.gmail.com>
<1112645479.16721.806.camel@localhost.localdomain>
<59d991c405040413184699cfe1@mail.gmail.com>
On Mon, 2005-04-04 at 16:18 -0400, Christopher Petrilli wrote:
> On Apr 4, 2005 4:11 PM, Simon Riggs <simon@2ndquadrant.com> wrote:
> > > > I'm very interested in the graphs of elapsed time for COPY 500 rows
> > > > against rows inserted. The simplistic inference from those graphs are
> > > > that if you only inserted 5 million rows into each table, rather than 10
> > > > million rows then everything would be much quicker. I hope this doesn't
> > > > work, but could you try that to see if it works? I'd like to rule out a
> > > > function of "number of rows" as an issue, or focus in on it depending
> > > > upon the results.
> >
> > Any chance of running a multiple load of 4 million rows per table,
> > leaving the test running for at least 3 tables worth (12+ M rows)?
>
> As soon as I get done running a test without indexes :-)
>
> > > > Q: Please can you confirm that the discontinuity on the graph at around
> > > > 5000 elapsed seconds matches EXACTLY with the switch from one table to
> > > > another? That is an important point.
> > >
> > > Well, the change over happens at 51593.395205 seconds :-) Here's two
> > > lines from the results with row count and time added:
> > >
> > > 10000000 51584.9818912 8.41331386566
> > > 10000500 51593.395205 0.416964054108
> > >
> My program *SPECIFICALLY* counts to 10M then switches the COPY statement.
> > OK. Please...
> > cd $PGDATA/base/26488263
> > ls -l
>
> [root@bigbird base]# cd 26488263/
> [root@bigbird 26488263]# ls -l
> total 2003740
> -rw------- 1 pgsql pgsql 1073741824 Apr 4 15:07 26488271
> -rw------- 1 pgsql pgsql 407527424 Apr 4 16:17 26488271.1
Can you do:
select relname from pg_class where relfilenode = 26488271
and confirm that the name is the table you've been loading...
Couldn't see all your indexes... are they still there?
Thanks,
Best Regards, Simon Riggs
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: simon@2ndquadrant.com, petrilli@gmail.com, tgl@sss.pgh.pa.us, scrappy@postgresql.org
Subject: Re: Sustained inserts per sec ... ?
In-Reply-To: <1112648303.16721.816.camel@localhost.localdomain>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox