From: Miernik <public@public.miernik.name>
To: pgsql-performance@postgresql.org
Subject: Re: how to fix problem then when two queries run at the same time, it takes longer to complete then if run in sequence
Date: Thu, 31 Jul 2008 10:29:30 +0200
Message-ID: <20080731082930.553C.0.NOFFLE@turbacz.local> (raw)
References: <20080723152112.30A4.0.NOFFLE@turbacz.local>
<dcc563d10807231025s617c6b16neb93c6348a658cdb@mail.gmail.com>
<20080723203203.31C4.0.NOFFLE@turbacz.local>
<488840D3.2090808@archonet.com>
<20080731061522.54FE.0.NOFFLE@turbacz.local>
<48916B6A.4070203@archonet.com>
Richard Huxton <dev@archonet.com> wrote:
>> I just installed pgpool2 and whoaaa! Everything its like about 3 times
>> faster! My application are bash scripts using psql -c "UPDATE ...".
>
> Probably spending most of their time setting up a new connection, then
> clearing it down again.
If I do it in Python it could do all queries in the same connection, so
should be faster? Besides that 'psql' is written in perl, so its also
heavy, by not using psql I get rid of perl library in RAM. Also the
script uses wget to poll some external data sources a lot, also
needlessly opening new connection to the webserver, so I want to make
the script save the http connection, which means I must get rid of wget.
Maybe I should write some parts in C?
BTW, doesn't there exist any tool does what "psql -c" does, but is
written in plain C, not perl? I was looking for such psql replacement,
but couldn't find any.
>> # Number of connection pools allowed for a child process
>> max_pool = 1
>
> Might need to increase that to 2 or 3.
Why? The website says:
max_pool
The maximum number of cached connections in pgpool-II children
processes. pgpool-II reuses the cached connection if an incoming
connection is connecting to the same database by the same username.
But all my connections are to the same database and the same username,
and I only ever want my application to do 1 connection to the database
at a time, so why would I want/need 2 or 3 in max_pool?
> Not well known enough on the Debian side of the fence? It's simple
> enough to install from source though. Takes about one minute.
But is there any advantage for me compared to pgpool2, which works
really nice? In some parts, like doing some count(*) stuff, it now does
things in about one second, which took a few minutes to finish before (if
the other part of the scripts where doing something else on the database
at the same time).
--
Miernik
http://miernik.name/
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: public@public.miernik.name
Subject: Re: how to fix problem then when two queries run at the same time, it takes longer to complete then if run in sequence
In-Reply-To: <20080731082930.553C.0.NOFFLE@turbacz.local>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox