pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Joshua Marsh <icub3d@gmail.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Large Database Performance suggestions
Date: Thu, 21 Oct 2004 23:37:00 -0400
Message-ID: <2568.1098416220@sss.pgh.pa.us> (raw)
In-Reply-To: <38242de904102120143c55ba34@mail.gmail.com>
References: <38242de904102120143c55ba34@mail.gmail.com>

Joshua Marsh <icub3d@gmail.com> writes:
> ... We did some original testing and with a server with 8GB or RAM and
> found we can do operations on data file up to 50 million fairly well,
> but performance drop dramatically after that.

What you have to ask is *why* does it drop dramatically?  There aren't
any inherent limits in Postgres that are going to kick in at that level.
I'm suspicious that you could improve the situation by adjusting
sort_mem and/or other configuration parameters; but there's not enough
info here to make specific recommendations.  I would suggest posting
EXPLAIN ANALYZE results for your most important queries both in the size
range where you are getting good results, and the range where you are not.
Then we'd have something to chew on.

			regards, tom lane



view thread (8+ messages)  latest in thread

Message-ID: <2568.1098416220@sss.pgh.pa.us>
Permalink:  ../2568.1098416220@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/2568.1098416220@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tgl@sss.pgh.pa.us, icub3d@gmail.com
  Subject: Re: Large Database Performance suggestions
  In-Reply-To: <2568.1098416220@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox