pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Scott Marlowe <smarlowe@qwest.net>
To: joe <joe@avsupport.com>
Cc: Postgresql Performance <pgsql-performance@postgresql.org>
Subject: Re: Beowulf Cluster & Postgresql?
Date: Wed, 21 Jul 2004 15:08:30 -0600
Message-ID: <1090444110.709.38.camel@localhost.localdomain> (raw)
In-Reply-To: <1090442756.7202.38.camel@localhost>
References: <1090442756.7202.38.camel@localhost>

On Wed, 2004-07-21 at 14:45, joe wrote:
> Hi all,
> 	I was wondering if part or all of Postgres would be able to take
> advantage of a beowulf cluster to increase performance?  If not then why
> not, and if so then how would/could it benefit from being on a cluster?
> 
> 	Thanks for the enlightenment in advance.

That type of clustering helps with large parallel processes that are
loosely interrelated or none at all.

In PostgreSQL, as in most databases, all actions that change the data in
the database tend to be highly interrelated, so it becomes very
expensive to pass all that locking information back and forth.  The very
thing a cluster would be good at, lots of reads, very few writies, is
the antithesis of what postgresql is built to be good at, lots of writes
as well as lots of reads.

Basically, clustering tends to make the database faster at reads and
slower at writes.  While there are clustering solutions out there,
Beowulf clustering is oriented towards highly parallel CPU intensive
workloads, while PostgreSQL tends to be I/O intensive, and since all the
data needs to be stored in one "master" place, adding nodes doesn't
usually help with making writes faster.




view thread (3+ messages)  latest in thread

Message-ID: <1090444110.709.38.camel@localhost.localdomain>
Permalink:  ../1090444110.709.38.camel@localhost.localdomain/
Also on:    postgresql.org/message-id/1090444110.709.38.camel@localhost.localdomain

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: smarlowe@qwest.net, joe@avsupport.com
  Subject: Re: Beowulf Cluster & Postgresql?
  In-Reply-To: <1090444110.709.38.camel@localhost.localdomain>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox