From: Greg Smith <gsmith@gregsmith.com>
To: Joe Mirabal <jmmirabal@gmail.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: count * performance issue
Date: Mon, 10 Mar 2008 19:01:43 -0400 (EDT)
Message-ID: <Pine.GSO.4.64.0803101853090.25041@westnet.com> (raw)
In-Reply-To: <12ba3bf00803101354w15b023e1o237f564a1b01105f@mail.gmail.com>
References: <f966c2ee0803052142l6a105678jfe2da92a0d9371@mail.gmail.com>
<47D00DB2.7040007@emolecules.com>
<18451.1204824562@sss.pgh.pa.us>
<200803071727.36146.josh@agliodbs.com>
<13345.1204940295@sss.pgh.pa.us>
<87r6eia9tz.fsf@oxford.xeocode.com>
<12ba3bf00803101354w15b023e1o237f564a1b01105f@mail.gmail.com>
On Mon, 10 Mar 2008, Joe Mirabal wrote:
> I run queries on the data nad get immediate max and min as well as other
> aggrgate functions very quickly, however a select count(*) of the table
> takes forever usually nearly an hour or more.
Are you sure the form of "select count(*)" you're using is actually
utilizing the index to find a useful subset? What do you get out of
EXPLAIN ANALZYE on the query?
In order for indexes to be helpful a couple of things need to happen:
1) They have to be structured correctly to be useful
2) There needs to be large enough settings for shared_buffes and
effective_cache_size that the database things it can use them efficiently
3) The tables involved need to be ANALYZEd to keep their statistics up to
date.
The parameters to run a 400GB *table* are very different from the
defaults; if you want tuning suggestions you should post the non-default
entries in your postgresql.conf file from what you've already adjusted
along with basic information about your server (PostgreSQL version, OS,
memory, disk setup).
> We in our warehouse use the count(*) as our verification of counts by
> day/month's etc
If you've got a database that size and you're doing that sort of thing on
it, you really should be considering partitioning as well.
--
* Greg Smith gsmith@gregsmith.com http://www.gregsmith.com Baltimore, MD
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: gsmith@gregsmith.com, jmmirabal@gmail.com
Subject: Re: count * performance issue
In-Reply-To: <Pine.GSO.4.64.0803101853090.25041@westnet.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox