pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedPoor performance of group by query
4+ messages / 4 participants
[nested] [flat]
* Poor performance of group by query
@ 2004-04-16 15:17 Jim C. Nasby <jim@nasby.net>
2004-04-16 16:36 ` Re: Poor performance of group by query Tom Lane <tgl@sss.pgh.pa.us>
2004-04-16 22:57 ` Re: Poor performance of group by query Greg Stark <gsstark@mit.edu>
2004-04-18 03:35 ` Re: Poor performance of group by query Mark Kirkwood <markir@paradise.net.nz>
0 siblings, 3 replies; 4+ messages in thread
From: Jim C. Nasby @ 2004-04-16 15:17 UTC (permalink / raw)
To: pgsql-performance
Anyone have any ideas why this query would be so slow?
stats=# explain analyze SELECT work_units, min(raw_rank) AS rank FROM Trank_work_overall GROUP BY work_units;
QUERY PLAN
-------------------------------------------------------------------------------------------------------------------------------
HashAggregate (cost=1050.12..1085.98 rows=14347 width=16) (actual time=163149.981..163227.758 rows=17849 loops=1)
-> Seq Scan on trank_work_overall (cost=0.00..804.41 rows=49141 width=16) (actual time=0.071..328.682 rows=49091 loops=1)
Total runtime: 163296.212 ms
(3 rows)
stats=# \d Trank_work_overall
Table "pg_temp_1.trank_work_overall"
Column | Type | Modifiers
------------+--------+-----------
raw_rank | bigint |
work_units | bigint |
stats=#
FreeBSD fritz.distributed.net 5.2.1-RELEASE FreeBSD 5.2.1-RELEASE #1:
Wed Apr 7 18:42:52 CDT 2004
root@fritz.distributed.net:/usr/obj/usr/src/sys/FRITZ amd64
The machine is a dual opteron with 4G of memory. The query in question
was not hitting the disk at all. PostgreSQL 7.4.2 compiled with -O3.
Also, if I set enable_hashagg = false, it runs in less than a second.
--
Jim C. Nasby, Database Consultant jim@nasby.net
Member: Triangle Fraternity, Sports Car Club of America
Give your computer some brain candy! www.distributed.net Team #1828
Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Poor performance of group by query
2004-04-16 15:17 Poor performance of group by query Jim C. Nasby <jim@nasby.net>
@ 2004-04-16 16:36 ` Tom Lane <tgl@sss.pgh.pa.us>
2 siblings, 0 replies; 4+ messages in thread
From: Tom Lane @ 2004-04-16 16:36 UTC (permalink / raw)
To: Jim C. Nasby <jim@nasby.net>; +Cc: pgsql-performance
"Jim C. Nasby" <jim@nasby.net> writes:
> Anyone have any ideas why this query would be so slow?
That seems very bizarre. Would you be willing to send me a dump of the
table off-list?
regards, tom lane
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Poor performance of group by query
2004-04-16 15:17 Poor performance of group by query Jim C. Nasby <jim@nasby.net>
@ 2004-04-16 22:57 ` Greg Stark <gsstark@mit.edu>
2 siblings, 0 replies; 4+ messages in thread
From: Greg Stark @ 2004-04-16 22:57 UTC (permalink / raw)
To: Jim C. Nasby <jim@nasby.net>; +Cc: pgsql-performance
> stats=# explain analyze SELECT work_units, min(raw_rank) AS rank FROM Trank_work_overall GROUP BY work_units;
>
> ...
>
> raw_rank | bigint |
> work_units | bigint |
If you create a copy of the same table using regular integers does that run
fast? And a copy of the table using bigints is still slow like the original?
I know bigints are less efficient than integers because they're handled using
dynamically allocated memory. This especially bites aggregate functions. But I
don't see why it would be any slower for a hash aggregate than a regular
aggregate. It's a pretty gross amount of time for 18k records.
There was a thought a while back about making 64-bit machines handle 64-bit
datatypes like bigints without pointers. That would help on your Opteron.
--
greg
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: Poor performance of group by query
2004-04-16 15:17 Poor performance of group by query Jim C. Nasby <jim@nasby.net>
@ 2004-04-18 03:35 ` Mark Kirkwood <markir@paradise.net.nz>
2 siblings, 0 replies; 4+ messages in thread
From: Mark Kirkwood @ 2004-04-18 03:35 UTC (permalink / raw)
To: Jim C. Nasby <jim@nasby.net>; +Cc: pgsql-performance
It might be worth trying out a build with -O2, just to rule out any -O3
oddness.
regards
Mark
Jim C. Nasby wrote:
> PostgreSQL 7.4.2 compiled with -O3.
>
>
>
>
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2004-04-18 03:35 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-04-16 15:17 Poor performance of group by query Jim C. Nasby <jim@nasby.net>
2004-04-16 16:36 ` Tom Lane <tgl@sss.pgh.pa.us>
2004-04-16 22:57 ` Greg Stark <gsstark@mit.edu>
2004-04-18 03:35 ` Mark Kirkwood <markir@paradise.net.nz>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox