pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Scaling with lazy index updates
2+ messages / 2 participants
[nested] [flat]

* Scaling with lazy index updates
@ 2004-07-17 03:30  Fred Moyer <fred@redhotpenguin.com>
  0 siblings, 1 reply; 2+ messages in thread

From: Fred Moyer @ 2004-07-17 03:30 UTC (permalink / raw)
  To: pgsql-performance

Pg Performers,

This might be a out of the ordinary question, or perhaps I have been out
of the loop for a while but does PostgreSQL (or any other database) have
support for lazy index updates.  What I mean by lazy index updates is
index updating which occur at a regular interval rather than per
transaction.

I have found that inserts and updates tend to slow down when the database
gets really big.  I think it is likely an effect of updating indexes when
the insert or update occurs.

Looking forward to feedback and possibly direction on my lazy index update
question.

TIA,

Fred



^ permalink  raw  reply  [nested|flat] 2+ messages in thread

* Re: Scaling with lazy index updates
@ 2004-07-18 00:02  Josh Berkus <josh@agliodbs.com>
  parent: Fred Moyer <fred@redhotpenguin.com>
  0 siblings, 0 replies; 2+ messages in thread

From: Josh Berkus @ 2004-07-18 00:02 UTC (permalink / raw)
  To: fred@redhotpenguin.com; pgsql-performance

Howdy Fred,

> This might be a out of the ordinary question, or perhaps I have been out
> of the loop for a while but does PostgreSQL (or any other database) have
> support for lazy index updates.  What I mean by lazy index updates is
> index updating which occur at a regular interval rather than per
> transaction.

In a word: No.

The issue with "asynchronous index updates" (which is what you asked about) is 
that they don't work with the way PostgreSQL uses indexes.   If the index 
hasn't been updated, then when a query uses an index scan the row simply 
wouldn't show up.    If that's acceptable behavior for you, then perhaps you 
could consider asynchronous *table* updates, done at the application layer, 
which would be much easier to implement.

We do as much as we can by offloading b-tree "cleanup" for indexes until 
VACUUM/REINDEX, which is called manually.   

Hmmm.   Can you think of an example of an RDBMS which does *not* update 
indexes immediately (and transactionally)?  I can't.

-- 
-Josh Berkus
 Aglio Database Solutions
 San Francisco




^ permalink  raw  reply  [nested|flat] 2+ messages in thread


end of thread, other threads:[~2004-07-18 00:02 UTC | newest]

Thread overview: 2+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-07-17 03:30 Scaling with lazy index updates Fred Moyer <fred@redhotpenguin.com>
2004-07-18 00:02 ` Josh Berkus <josh@agliodbs.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox