pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Brian Hurt <bhurt@janestcapital.com>
Cc: pgsql-performance@postgresql.org
Cc: pgsql-advocacy@postgresql.org
Subject: Re: [PERFORM] Postgres and really huge tables
Date: Thu, 18 Jan 2007 16:52:58 -0500
Message-ID: <6593.1169157178@sss.pgh.pa.us> (raw)
In-Reply-To: <45AFD927.9050605@janestcapital.com>
References: <4939.1164740825@sss.pgh.pa.us>
	<200611282344.kASNijt09203@momjian.us>
	<456CE066.50803@cheapcomplexdevices.com>
	<456D8A65.3080400@janestcapital.com>
	<1164812624.9690.500.camel@archimedes>
	<456DA476.4000606@janestcapital.com>
	<456DB8C9.7020206@cheapcomplexdevices.com>
	<45AFD927.9050605@janestcapital.com>

Brian Hurt <bhurt@janestcapital.com> writes:
> Is there any experience with Postgresql and really huge tables?  I'm 
> talking about terabytes (plural) here in a single table.

The 2MASS sky survey point-source catalog
http://www.ipac.caltech.edu/2mass/releases/allsky/doc/sec2_2a.html
is 470 million rows by 60 columns; I don't have it loaded up but
a very conservative estimate would be a quarter terabyte.  (I've
got a copy of the data ... 5 double-sided DVDs, gzipped ...)
I haven't heard from Rae Stiening recently but I know he's been using
Postgres to whack that data around since about 2001 (PG 7.1 or so,
which is positively medieval compared to current releases).  So at
least for static data, it's certainly possible to get useful results.
What are your processing requirements?

			regards, tom lane



view thread (10+ messages)  latest in thread

Message-ID: <6593.1169157178@sss.pgh.pa.us>
Permalink:  ../6593.1169157178@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/6593.1169157178@sss.pgh.pa.us

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tgl@sss.pgh.pa.us, bhurt@janestcapital.com, pgsql-advocacy@postgresql.org
  Subject: Re: [PERFORM] Postgres and really huge tables
  In-Reply-To: <6593.1169157178@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox