pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Creating a correct and real benchmark
4+ messages / 3 participants
[nested] [flat]

* Creating a correct and real benchmark
@ 2006-02-20 10:50  Marcos <mjs_ops@gmx.net>
  0 siblings, 1 reply; 4+ messages in thread

From: Marcos @ 2006-02-20 10:50 UTC (permalink / raw)
  To: pgsql-performance

Hi, 

I'm developing a search engine using the postgresql's databas. I've
already doing some tunnings looking increase the perform. 

Now, I'd like of do a realistic test of perfom with number X of queries
for know the performance with many queries. 

What the corret way to do this? 

Thanks.




^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Creating a correct and real benchmark
@ 2006-02-21 00:14  PFC <lists@peufeu.com>
  parent: Marcos <mjs_ops@gmx.net>
  0 siblings, 1 reply; 4+ messages in thread

From: PFC @ 2006-02-21 00:14 UTC (permalink / raw)
  To: Marcos <mjs_ops@gmx.net>; pgsql-performance


> I'm developing a search engine using the postgresql's databas. I've
> already doing some tunnings looking increase the perform.
>
> Now, I'd like of do a realistic test of perfom with number X of queries
> for know the performance with many queries.
>
> What the corret way to do this?


	I guess the only way to know how it will perform with your own  
application is to benchmark it with queries coming from your own  
application. You can create a test suite with a number of typical queries  
and use your favourite scripting language to spawn a number of threads and  
hammer the database. I find it interesting to measure the responsiveness  
of the server while torturing it, simply by measuring the time it takes to  
respond to a simple query and graphing it. Also you should not have N  
threads issue the exact same queries, because then you will hit a too  
small dataset. Introduce some randomness in the testing, for instance.  
Benchmarking from another machine makes sure the test client's CPU usage  
is not a part of the problem.



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Creating a correct and real benchmark
@ 2006-02-21 00:21  Chris <dmagick@gmail.com>
  parent: PFC <lists@peufeu.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Chris @ 2006-02-21 00:21 UTC (permalink / raw)
  To: Marcos <mjs_ops@gmx.net>; +Cc: pgsql-performance

PFC wrote:
> 
>> I'm developing a search engine using the postgresql's databas. I've
>> already doing some tunnings looking increase the perform.
>>
>> Now, I'd like of do a realistic test of perfom with number X of queries
>> for know the performance with many queries.
>>
>> What the corret way to do this?
> 
> 
> 
>     I guess the only way to know how it will perform with your own  
> application is to benchmark it with queries coming from your own  
> application. You can create a test suite with a number of typical 
> queries  and use your favourite scripting language to spawn a number of 
> threads and  hammer the database. I find it interesting to measure the 
> responsiveness  of the server while torturing it, simply by measuring 
> the time it takes to  respond to a simple query and graphing it. Also 
> you should not have N  threads issue the exact same queries, because 
> then you will hit a too  small dataset. Introduce some randomness in the 
> testing, for instance.  Benchmarking from another machine makes sure the 
> test client's CPU usage  is not a part of the problem.

The other advice on top of this is don't just import a small amount of data.

If your application is going to end up with 200,000 rows - then test 
with 200,000 rows or more so you know exactly how it will handle under 
"production" conditions.



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: Creating a correct and real benchmark
@ 2006-02-24 17:06  Marcos <mjs_ops@gmx.net>
  parent: Chris <dmagick@gmail.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Marcos @ 2006-02-24 17:06 UTC (permalink / raw)
  To: Chris <dmagick@gmail.com>; +Cc: pgsql-performance

Thanks for advises :-D.

Marcos




^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2006-02-24 17:06 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-02-20 10:50 Creating a correct and real benchmark Marcos <mjs_ops@gmx.net>
2006-02-21 00:14 ` PFC <lists@peufeu.com>
2006-02-21 00:21   ` Chris <dmagick@gmail.com>
2006-02-24 17:06     ` Marcos <mjs_ops@gmx.net>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox