pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Adrian Moisey <adrian@careerjunction.co.za>
Cc: pgsql-performance@postgresql.org
Subject: Re: Linux/PostgreSQL scalability issue - problem with 8 cores
Date: Tue, 15 Jan 2008 10:51:04 -0500
Message-ID: <24097.1200412264@sss.pgh.pa.us> (raw)
In-Reply-To: <478CA662.4060505@careerjunction.co.za>
References: <flii57$748$1@news.hub.org>
	<7083.1199379570@sss.pgh.pa.us>
	<477D1D59.7050002@comgate.cz>
	<4782063C.7070105@comgate.cz>
	<26502.1199745090@sss.pgh.pa.us>
	<4782AB4D.8010009@comgate.cz>
	<27655.1199750492@sss.pgh.pa.us>
	<47836A4C.5080707@comgate.cz>
	<10713.1199813111@sss.pgh.pa.us>
	<47874EE8.2050406@comgate.cz>
	<12997.1200063940@sss.pgh.pa.us>
	<478B4BB9.4030208@comgate.cz>
	<13894.1200324134@sss.pgh.pa.us>
	<478CA26E.9040105@comgate.cz>
	<478CA662.4060505@careerjunction.co.za>

Adrian Moisey <adrian@careerjunction.co.za> writes:
>> we've found it: TRUNCATE

> I haven't been following this thread.  Can someone please explain to me 
> why TRUNCATE causes these spikes?

It's not so much the TRUNCATE as the overhead of broadcasting the
resultant catalog changes to the many hundreds of (mostly idle)
backends he's got --- all of which respond by trying to lock the
shared sinval message queue at about the same time.

You could see the whole thread as an object lesson in why connection
pooling is a good idea.  But certainly it seems that sinval is the
next bottleneck in terms of being able to scale Postgres up to very
large numbers of backends.

			regards, tom lane



view thread (30+ messages)  latest in thread

Message-ID: <24097.1200412264@sss.pgh.pa.us>
Permalink:  ../24097.1200412264@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/24097.1200412264@sss.pgh.pa.us

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tgl@sss.pgh.pa.us, adrian@careerjunction.co.za
  Subject: Re: Linux/PostgreSQL scalability issue - problem with 8 cores
  In-Reply-To: <24097.1200412264@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox