pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Carlo Stonebanks <stonec.register@sympatico.ca>
To: pgsql-performance@postgresql.org
Subject: Re: Massive table (500M rows) update nightmare
Date: Fri, 8 Jan 2010 01:14:58 -0500
Message-ID: <hi6ifm$1bi8$1@news.hub.org> (raw)
In-Reply-To: <dcc563d11001071740q572cdae2re410788fe790dbf6@mail.gmail.com>
References: <hi41os$eiv$1@news.hub.org>
	<b1b9fac61001071305vf182f3ajff6827f92c943c68@mail.gmail.com>
	<hi5kpr$184c$1@news.hub.org>
	<dcc563d11001071740q572cdae2re410788fe790dbf6@mail.gmail.com>

> It might well be checkpoints.  Have you tried cranking up checkpoint
> segments to something like 100 or more and seeing how it behaves then?

No I haven't, althugh it certainly make sense - watching the process run, 
you get this sense that the system occaisionally pauses to take a deep, long 
breath before returning to work frantically ;D

Checkpoint_segments are currently set to 64. The DB is large and is on a 
constant state of receiving single-row updates as multiple ETL and 
refinement processes run continuously.

Would you expect going to 100 or more to make an appreciable difference, or 
should I be more aggressive?
> 




view thread (30+ messages)  latest in thread

Message-ID: <hi6ifm$1bi8$1@news.hub.org>
Permalink:  ../hi6ifm$1bi8$1@news.hub.org/
Also on:    postgresql.org/message-id/hi6ifm$1bi8$1@news.hub.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: stonec.register@sympatico.ca
  Subject: Re: Massive table (500M rows) update nightmare
  In-Reply-To: <hi6ifm$1bi8$1@news.hub.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox