pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Steve Wampler <swampler@noao.edu>
To: Hervé Piedvache <herve@elma.fr>
Cc: Joshua D. Drake <jd@commandprompt.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: PostgreSQL clustering VS MySQL clustering
Date: Thu, 20 Jan 2005 08:14:28 -0700
Message-ID: <41EFCAD4.6040307@noao.edu> (raw)
In-Reply-To: <200501201600.47583.herve@elma.fr>
References: <200501201503.31241.herve@elma.fr>
	<41EFC3C0.6080903@commandprompt.com>
	<200501201600.47583.herve@elma.fr>

Hervé Piedvache wrote:

> 
> No ... as I have said ... how I'll manage a database getting a table of may be 
> 250 000 000 records ? I'll need incredible servers ... to get quick access or 
> index reading ... no ?
> 
> So what we would like to get is a pool of small servers able to make one 
> virtual server ... for that is called a Cluster ... no ?
> 
> I know they are not using PostgreSQL ... but how a company like Google do to 
> get an incredible database in size and so quick access ?

Probably by carefully partitioning their data.  I can't imagine anything
being fast on a single table in 250,000,000 tuple range.  Nor can I
really imagine any database that efficiently splits a single table
across multiple machines (or even inefficiently unless some internal
partitioning is being done).

So, you'll have to do some work at your end and not just hope that
a "magic bullet" is available.

Once you've got the data partitioned, the question becomes one of
how to inhance performance/scalability.  Have you considered RAIDb?


-- 
Steve Wampler -- swampler@noao.edu
The gods that smiled on your birth are now laughing out loud.



view thread (131+ messages)  latest in thread

Message-ID: <41EFCAD4.6040307@noao.edu>
Permalink:  ../41EFCAD4.6040307@noao.edu/
Also on:    postgresql.org/message-id/41EFCAD4.6040307@noao.edu

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: swampler@noao.edu, herve@elma.fr, jd@commandprompt.com
  Subject: Re: PostgreSQL clustering VS MySQL clustering
  In-Reply-To: <41EFCAD4.6040307@noao.edu>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox