pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Josh Berkus <josh@agliodbs.com>
To: pgsql-performance@postgresql.org
Cc: Bruce Momjian <pgman@candle.pha.pa.us>
Subject: Re: memcached and PostgreSQL
Date: Sun, 21 Nov 2004 20:27:15 -0800
Message-ID: <200411212027.15554.josh@agliodbs.com> (raw)
In-Reply-To: <200411220415.iAM4Fh908507@candle.pha.pa.us>
References: <200411220415.iAM4Fh908507@candle.pha.pa.us>

Bruce,

> The big concern I have about memcache is that because it controls
> storage external to the database there is no way to guarantee the cache
> is consistent with the database.  This is similar to sending email in a
> trigger or on commit where you can't be certain you send email always
> and only on a commit.

Well, some things ... ON COMMIT triggers, or messages with NOTIFY, would 
improve the accuracy by cutting down on cached aborted transactions.  

However, caching is of necessity imperfect.   Caching is a trade-off; greater 
access speed vs. perfect consistency (and any durability).    There are cases 
where the access speed is more important than the consistency (or the 
durability).   The answer is to use memcached judiciously and be prepared to 
account for minor inconsistencies.    

For that matter, as with other forms of cumulative asynchronous materialized 
view, it would be advisable to nightly re-build copies of data stored in 
memcached from scratch during system slow time, assuming that the data in 
memcached corresponds to a real table.  Where memcached does not correspond 
to a real table (session keys, for example), it is not a concern at all.

-- 
Josh Berkus
Aglio Database Solutions
San Francisco



view thread (17+ messages)  latest in thread

Message-ID: <200411212027.15554.josh@agliodbs.com>
Permalink:  ../200411212027.15554.josh@agliodbs.com/
Also on:    postgresql.org/message-id/200411212027.15554.josh@agliodbs.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: josh@agliodbs.com, pgman@candle.pha.pa.us
  Subject: Re: memcached and PostgreSQL
  In-Reply-To: <200411212027.15554.josh@agliodbs.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox