pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: John Arbash Meinel <john@arbash-meinel.com>
To: Miroslav Šulc <miroslav.sulc@startnet.cz>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: pgsql-performance@postgresql.org
Cc: pgsql-hackers@postgresql.org
Subject: Re: [PERFORM] How to read query plan
Date: Mon, 14 Mar 2005 09:54:29 -0600
Message-ID: <4235B3B5.3040209@arbash-meinel.com> (raw)
In-Reply-To: <42354EA7.4020907@startnet.cz>
References: <42345D24.8070104@startnet.cz>
	<4234692E.3050802@arbash-meinel.com>
	<42347407.2000202@startnet.cz>
	<423478B1.7080106@arbash-meinel.com>
	<18381.1110741354@sss.pgh.pa.us>
	<423497FE.6040908@startnet.cz>
	<19293.1110743673@sss.pgh.pa.us>
	<42349C96.60401@startnet.cz>
	<3174.1110745587@sss.pgh.pa.us>
	<4234AF56.1040509@startnet.cz>
	<6715.1110758921@sss.pgh.pa.us>
	<42354EA7.4020907@startnet.cz>

Miroslav Šulc wrote:

> Tom Lane wrote:
>
>> ...
>> I think the reason this is popping to the top of the runtime is that the
>> joins are so wide (an average of ~85 columns in a join tuple according
>> to the numbers above).  Because there are lots of variable-width columns
>> involved, most of the time the fast path for field access doesn't apply
>> and we end up going to nocachegetattr --- which itself is going to be
>> slow because it has to scan over so many columns.  So the cost is
>> roughly O(N^2) in the number of columns.
>>
>>
> As there are a lot of varchar(1) in the AdDevicesSites table, wouldn't
> be helpful to change them to char(1)? Would it solve the
> variable-width problem at least for some fields and speed the query up?
>
I'm guessing there really wouldn't be a difference. I think varchar()
and char() are stored the same way, just one always has space padding. I
believe they are both varlena types, so they are still "variable" length.

>> As a short-term hack, you might be able to improve matters if you can
>> reorder your LEFT JOINs to have the minimum number of columns
>> propagating up from the earlier join steps.  In other words make the
>> later joins add more columns than the earlier, as much as you can.
>>
>>
> That will be hard as the main table which contains most of the fields
> is LEFT JOINed with the others. I'll look at it if I find some way to
> improve it.

One thing that you could try, is to select just the primary keys from
the main table, and then later on, join back to that table to get the
rest of the columns. It is a little bit hackish, but if it makes your
query faster, you might want to try it.

>
> I'm not sure whether I understand the process of performing the plan
> but I imagine that the data from AdDevicesSites are retrieved only
> once when they are loaded and maybe stored in memory. Are the columns
> stored in the order they are in the SQL command? If so, wouldn't it be
> useful to move all varchar fields at the end of the SELECT query? I'm
> just guessing because I don't know at all how a database server is
> implemented and what it really does.
>
I don't think they are stored in the order of the SELECT <> portion. I'm
guessing they are loaded and saved as you go. But that the order of the
LEFT JOIN at the end is probably important.

>> ..
>>             regards, tom lane
>>
>>
> Miroslav


John
=:->

Attachments:

  signature.asc (application/pgp-signature, 252B) download

view thread (37+ messages)  latest in thread

Message-ID: <4235B3B5.3040209@arbash-meinel.com>
Permalink:  ../4235B3B5.3040209@arbash-meinel.com/
Also on:    postgresql.org/message-id/4235B3B5.3040209@arbash-meinel.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: john@arbash-meinel.com, miroslav.sulc@startnet.cz, tgl@sss.pgh.pa.us, pgsql-hackers@postgresql.org
  Subject: Re: [PERFORM] How to read query plan
  In-Reply-To: <4235B3B5.3040209@arbash-meinel.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox