pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Josh Berkus <josh@agliodbs.com>
To: pgsql-performance@postgresql.org
Subject: Re: external sort performance
Date: Thu, 17 Nov 2011 16:46:05 -0800
Message-ID: <4EC5AACD.9010802@agliodbs.com> (raw)
In-Reply-To: <CAKuK5J26EWApdZHt9kKMhfh6y4pfjp8soJwXxoUexHjs8mYgMQ@mail.gmail.com>
References: <CAKuK5J3taH85P6zc1j63mkwiNXH2nfJ5ER6R1+Vk5iG_Cq-cFw@mail.gmail.com>
	<CAGTBQpYSp3+Vca+2Qu7wb34++BD674+wOGWXTATFJ2Hnuqwk_g@mail.gmail.com>
	<CAKuK5J3ZTLKG4ozhtnoGpYoZDzXtaMtdXcCuUJj1-X1brb5hyg@mail.gmail.com>
	<CAKuK5J26EWApdZHt9kKMhfh6y4pfjp8soJwXxoUexHjs8mYgMQ@mail.gmail.com>


> The first log statement is expected. The second log statement, however, isn't.
> The total table size is (as noted earlier) about 5GB and, in fact, fit
> into one nice hash table (approx 15GB in size).
> Is the sorting that is necessary for index creation unable to use a
> hash table? (This is a standard btree index).

How big is the source table?  You're not sorting the *result* table,
you're sorting the source table if you're summarizing it.

If the original source data is only 5GB, I'd check your code for a
cartesian join.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com



view thread (11+ messages)  latest in thread

Message-ID: <4EC5AACD.9010802@agliodbs.com>
Permalink:  ../4EC5AACD.9010802@agliodbs.com/
Also on:    postgresql.org/message-id/4EC5AACD.9010802@agliodbs.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: josh@agliodbs.com
  Subject: Re: external sort performance
  In-Reply-To: <4EC5AACD.9010802@agliodbs.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox