DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com;
	h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references;
	b=iyjsSuCvUJvaUNJwO+eKhaBdUg3zPl7pUCHYZuln7EatkQvJUaxOMDMxlaQ/NTC/oRermpE4rsfbSYVVMUpykmHGGC0TLeygoEnZbr/LsynpzFrJ9FxZvH16bCrt+//MI9GWBuiTJsHwUDPRjZkm40YTGH19GXcssAkw/YM2JZY=
Message-ID: <59d991c405071812342e290f57@mail.gmail.com>
Date: Mon, 18 Jul 2005 15:34:57 -0400
From: Christopher Petrilli <petrilli@gmail.com>
Reply-To: Christopher Petrilli <petrilli@gmail.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Subject: Re: Impact of checkpoint_segments under continual load conditions
Cc: Vivek Khera <vivek@khera.org>, pgsql-performance@postgresql.org
In-Reply-To: <16394.1121715156@sss.pgh.pa.us>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
References: <59d991c4050717100874c08a86@mail.gmail.com>
	<A50B8A1F-71A1-4F63-A5F4-1AA58F89557D@khera.org>
	<59d991c405071811457ccdd3f1@mail.gmail.com>
	<16394.1121715156@sss.pgh.pa.us>

On 7/18/05, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> Christopher Petrilli <petrilli@gmail.com> writes:
> > http://blog.amber.org/diagrams/comparison_mysql_pgsql.png
>=20
> > Notice the VERY steep drop off.
>=20
> Hmm.  Whatever that is, it's not checkpoint's fault.  I would interpret
> the regular upticks in the Postgres times (every several hundred
> iterations) as being the effects of checkpoints.  You could probably
> smooth out those peaks some with appropriate hacking on bgwriter
> parameters, but that's not the issue at hand (is it?).

I tried hacking that, turning it up to be more agressive, it got
worse.  Turned it down, it got worse :-)
=20
> I have no idea at all what's causing the sudden falloff in performance
> after about 10000 iterations.  COPY per se ought to be about a
> constant-time operation, since APPEND is (or should be) constant-time.
> What indexes, foreign keys, etc do you have on this table?  What else
> was going on at the time?

The table has 15 columns, 5 indexes (character, inet and timestamp).
No foreign keys. The only other thing running on the machine was the
application actually DOING the benchmarking, written in Python
(psycopg), but it was, according to top, using less than 1% of the
CPU.  It was just talking through a pipe to a psql prompt to do the
COPY.

Chris
--=20
| Christopher Petrilli
| petrilli@gmail.com