pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Vitalii Tymchyshyn <tivv00@gmail.com>
To: Aren Cambre <aren@arencambre.com>
Cc: Craig Ringer <craig@postnewspapers.com.au>
Cc: pgsql-performance@postgresql.org
Subject: Re: Postgres refusing to use >1 core
Date: Thu, 12 May 2011 10:28:49 +0300
Message-ID: <4DCB8C31.2000606@gmail.com> (raw)
In-Reply-To: <BANLkTi=NC8UY4Se-Z_iJMVPWPMKyzc5fog@mail.gmail.com>
References: <BANLkTimohiUa6rOYdxYTwqmvSUg2CRYMHg@mail.gmail.com>
	<4DC81A3F020000250003D433@gw.wicourts.gov>
	<BANLkTimNTLqQgQeyu=FPOn-5x6F4XnVBJA@mail.gmail.com>
	<4DC81D56020000250003D438@gw.wicourts.gov>
	<BANLkTi=FH4rX-7OtS9ozjuyXQTNTiRqCmg@mail.gmail.com>
	<BANLkTinwkj7syvKkYzU_O7DD14EMzk2Zmg@mail.gmail.com>
	<BANLkTi=BvGMvsBNq8DUt=_MPJXZjcC0TWg@mail.gmail.com>
	<4DC8B893.3060908@postnewspapers.com.au>
	<BANLkTimi+2nviLvWU4zKGtG688+Z84DF6w@mail.gmail.com>
	<4DC9E7C5.9080309@postnewspapers.com.au>
	<BANLkTi=NC8UY4Se-Z_iJMVPWPMKyzc5fog@mail.gmail.com>

12.05.11 06:18, Aren Cambre ???????(??):
>
>     > Using one thread, the app can do about 111 rows per second, and it's
>     > only exercising 1.5 of 8 CPU cores while doing this. 12,000,000
>     rows /
>     > 111 rows per second ~= 30 hours.
>
>     I don't know how I missed that. You ARE maxing out one cpu core, so
>     you're quite right that you need more threads unless you can make your
>     single worker more efficient.
>
>
> And the problem is my app already has between 20 and 30 threads. 
> Something about C#'s PLINQ may not be working as intended...
>
Have you checked that you are really doing fetch and processing in 
parallel? Dunno about C#, but under Java you have to make specific 
settings (e.g. setFetchSize) or driver will fetch all the data on query 
run. Check time needed to fetch first row from the query.

Best regards, Vitalii Tymchyshyn

view thread (46+ messages)  latest in thread

Message-ID: <4DCB8C31.2000606@gmail.com>
Permalink:  ../4DCB8C31.2000606@gmail.com/
Also on:    postgresql.org/message-id/4DCB8C31.2000606@gmail.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tivv00@gmail.com, aren@arencambre.com, craig@postnewspapers.com.au
  Subject: Re: Postgres refusing to use >1 core
  In-Reply-To: <4DCB8C31.2000606@gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox