pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jonah H. Harris <jonah.harris@gmail.com>
To: henk de wit <henk53602@hotmail.com>
Cc: pgsql-performance@postgresql.org <pgsql-performance@postgresql.org>
Subject: Re: Utilizing multiple cores for one query
Date: Sat, 1 Dec 2007 11:39:15 -0500
Message-ID: <36e682920712010839k4cf3b778h518aea2c5e3eb9bc@mail.gmail.com> (raw)
In-Reply-To: <BAY124-W118FBDAAF28CB55D8A705AF5720@phx.gbl>
References: <BAY124-W312F15BBE3D85AE1D472F8F5720@phx.gbl>
	<36e682920712010531k47871797ge19ceaddad9a7ff6@mail.gmail.com>
	<BAY124-W118FBDAAF28CB55D8A705AF5720@phx.gbl>

On Dec 1, 2007 9:42 AM, henk de wit <henk53602@hotmail.com> wrote:
> Wouldn't this offer some opportunities for running things on multiple cores?

No, it's not actually parallel in the same sense.

> Yes, I noticed this project before. At the time it was not really clear how
> stable and/or how well supported this is. It indeed seems to support
> parallel queries automatically by being able to rewrite standard queries. It
> does seem it needs different DB nodes and is thus probably not able to use
> multiple cores of a single DBMS.

I've seen it actually set up to use multiple connections to the same
DBMS.  How well it would work is pretty much dependent on your
application and the amount of parallelization you could actually gain.


> Also, I could not really find how well
> pgpool-II is doing at making judgments of the level of parallelization it's
> going to use. E.g. when there are 16 nodes in the system with a currently
> low utilization, a single query may be split into 16 pieces. On the other
> hand, when 8 of these nodes are heavily utilized, splitting to 8 pieces
> might be better. etc.

IIRC, it doesn't plan parallelization that way.  It looks at what is
partitioned (by default) on different nodes and parallelizes based on
that.  As I said earlier, you can partition a single node and put
pgpool-II on top of it to gain some parallelization.  Unfortunately,
it isn't capable of handling things like parallel index builds or
other useful maintenance features... but it can do fairly good query
result parallelization.

-- 
Jonah H. Harris, Sr. Software Architect | phone: 732.331.1324
EnterpriseDB Corporation                | fax: 732.331.1301
499 Thornall Street, 2nd Floor          | jonah.harris@enterprisedb.com
Edison, NJ 08837                        | http://www.enterprisedb.com/



view thread (7+ messages)  latest in thread

Message-ID: <36e682920712010839k4cf3b778h518aea2c5e3eb9bc@mail.gmail.com>
Permalink:  ../36e682920712010839k4cf3b778h518aea2c5e3eb9bc@mail.gmail.com/
Also on:    postgresql.org/message-id/36e682920712010839k4cf3b778h518aea2c5e3eb9bc@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: jonah.harris@gmail.com, henk53602@hotmail.com
  Subject: Re: Utilizing multiple cores for one query
  In-Reply-To: <36e682920712010839k4cf3b778h518aea2c5e3eb9bc@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox