pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Christopher Browne <cbbrowne@acm.org>
To: pgsql-admin@postgresql.org
Subject: Re: High Availability for PostgreSQL
Date: Fri, 08 Oct 2004 18:34:26 -0400
Message-ID: <m3ekk8zvnx.fsf@wolfe.cbbrowne.com> (raw)
References: <s16676f7.097@co.kern.ca.us>

Centuries ago, Nostradamus foresaw when schooleys@co.kern.ca.us ("Sharon Schooley") would write:
> We are looking for a 24/7 PostgreSQL solution. I've read some
> postings and information on various solutions including Taygeta,
> pgpool, and Mammoth PostgreSQL with Heartbeat.  If there are any
> users of these or other PostgreSQL high availability solutions out
> there, can you respond and let me know what is working for you and
> how long you have been up and running?    Our project is a high
> profile but simple application that must run 24/7.  We are a county
> government entity.  We are not currently PostgreSQL users.  Our o/s
> is Suse 9.0 Pro Server.

The issues likely have more to do with what kind of hardware you are
running than the software.

To build an HA system generally requires looking at _all_ the pieces,
to make sure they fit together well, including:

 - The database itself
 - Middleware
 - Hardware, including such things as:
    - Redundant servers
    - Servers containing redundant hardware (e.g. - extra CPUs,
      memory boards)
    - Network appliances
 - Applications using the stuff in the lower layers

Sometimes the middleware can hide hardware outages while backup
hardware "spins up"; if the applications are designed to be either
more or less forgiving of outages, that can either help or hurt.

Running a demanding application 168h/week on a set of hardware
infrastructure not designed for that will leave considerable risk of
embarrassing failures.

We've got people looking into AIX+HACMP for some applications; one
thing we discovered is that this (expensive) technology is likely to
make system reliability MUCH WORSE if it is not used properly.

What you'll need (similar to the HACMP efforts) is to have the time to
test your systems well under considerable load in order to figure out
what are the "sharp edges" so that the system 'bleeds' a little in QA,
but runs well in production.  

There will always be some of this, whatever set of technologies you
pick for any complex project.

There's always some unexpected local lessons to learn.

After we ran the Slony-I replication system for about a week, we
determined that it was _vital_ to do regular maintenance ("vacuuming")
on the internal table "pg_listener" otherwise system performance would
steadily get pretty bad.

Your application will have different patterns, but there will be some
[likely small] set of vital bottlenecks, hard to discover until it is
under load.  Changing technologies will merely change which
bottlenecks you hit :-).
-- 
(reverse (concatenate 'string "moc.liamg" "@" "enworbbc"))
http://www.ntlug.org/~cbbrowne/unix.html
There's a  new language called C+++.   The only problem  is every time
you try to compile your modem disconnects.



view thread (4+ messages)  latest in thread

Message-ID: <m3ekk8zvnx.fsf@wolfe.cbbrowne.com>
Permalink:  ../m3ekk8zvnx.fsf@wolfe.cbbrowne.com/
Also on:    postgresql.org/message-id/m3ekk8zvnx.fsf@wolfe.cbbrowne.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: cbbrowne@acm.org
  Subject: Re: High Availability for PostgreSQL
  In-Reply-To: <m3ekk8zvnx.fsf@wolfe.cbbrowne.com>
  References: <s16676f7.097@co.kern.ca.us> <m3ekk8zvnx.fsf@wolfe.cbbrowne.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox