pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Re: Suggestions for benchmarking 7.4RC2 against 7.3
6+ messages / 3 participants
[nested] [flat]

* Suggestions for benchmarking 7.4RC2 against 7.3
@ 2003-11-12 14:47 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-12 15:04 ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  0 siblings, 1 reply; 6+ messages in thread

From: Rajesh Kumar Mallah @ 2003-11-12 14:47 UTC (permalink / raw)
  To: pgsql-performance


Hi,

I  plan to put 7.4-RC2 in our production servers in next few hours.

Since the hardware config & the performance related GUCs parameter
are  going to remain the same i am interested in seeing the performance
improvements in 7.4 as compared 7.3 .

For this i plan to use the OSDB 0.14  and compare the results for both the
cases.

Does any one has suggestions for comparing 7.4 against 7.3 ?
Since i am using OSDB for second time only any tips/guidance
on usage of that is also appreciated.



H/W config:

CPU: 4 X Intel(R) Xeon(TM) CPU 2.00GHz
MEM : 2 GB
I/O config : PGDATA on 10000 RPM Ultra160 scsi , pg_xlog on a similar
seperate SCSI

GUC:
shared_buffers = 10000
max_fsm_relations = 5000
max_fsm_pages = 55099264
sort_mem = 16384
vacuum_mem = 8192

All other performance related parameter have default
value eg:

#effective_cache_size = 1000    # typically 8KB each
#random_page_cost = 4           # units are one sequential page fetch cost
#cpu_tuple_cost = 0.01          # (same)
#cpu_index_tuple_cost = 0.001   # (same)
#cpu_operator_cost = 0.0025     # (same)



BTW i get following error at the moment:
-----------------------------------------
/usr/local/bin/osdb-pg-ui --postgresql=no_hash_index
"osdb"
"Invoked: /usr/local/bin/osdb-pg-ui --postgresql=no_hash_index"

                  create_tables()        0.78 seconds    return value = 0
                           load()        1.02 seconds    return value = 0
      create_idx_uniques_key_bt()        0.64 seconds    return value = 0
      create_idx_updates_key_bt()        0.61 seconds    return value = 0
      create_idx_hundred_key_bt()        0.61 seconds    return value = 0
       create_idx_tenpct_key_bt()        0.62 seconds    return value = 0
  create_idx_tenpct_key_code_bt()        0.45 seconds    return value = 0
         create_idx_tiny_key_bt()        0.46 seconds    return value = 0
       create_idx_tenpct_int_bt()        0.46 seconds    return value = 0
    create_idx_tenpct_signed_bt()        0.45 seconds    return value = 0
      create_idx_uniques_code_h()        0.46 seconds    return value = 0
    create_idx_tenpct_double_bt()        0.46 seconds    return value = 0
    create_idx_updates_decim_bt()        0.45 seconds    return value = 0
     create_idx_tenpct_float_bt()        0.46 seconds    return value = 0
      create_idx_updates_int_bt()        0.46 seconds    return value = 0
     create_idx_tenpct_decim_bt()        0.46 seconds    return value = 0
      create_idx_hundred_code_h()        0.45 seconds    return value = 0
       create_idx_tenpct_name_h()        0.46 seconds    return value = 0
      create_idx_updates_code_h()        0.46 seconds    return value = 0
       create_idx_tenpct_code_h()        0.45 seconds    return value = 0
   create_idx_updates_double_bt()        0.46 seconds    return value = 0
     create_idx_hundred_foreign()        0.41 seconds    return value = 0
               populateDataBase()        11.54 seconds   return value = 0

Error in test Counting tuples at (6746)osdb.c:294:
... empty database -- empty results
perror() reports: Resource temporarily unavailable

someone sighup'd the parent

Any clue?

------------------------------------------


Regards
Mallah.








^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Suggestions for benchmarking 7.4RC2 against 7.3
  2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
@ 2003-11-12 15:04 ` Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-11 18:08   ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Christopher Browne <cbbrowne@acm.org>
  0 siblings, 1 reply; 6+ messages in thread

From: Rajesh Kumar Mallah @ 2003-11-12 15:04 UTC (permalink / raw)
  To: Rajesh Kumar Mallah <mallah@trade-india.com>; +Cc: pgsql-performance



the error mentioned in first email has been overcome
by running osdb on the same machine hosting the DB server.

regds
mallah.

Rajesh Kumar Mallah wrote:

>
> Hi,
>
> I  plan to put 7.4-RC2 in our production servers in next few hours.
>
> Since the hardware config & the performance related GUCs parameter
> are  going to remain the same i am interested in seeing the performance
> improvements in 7.4 as compared 7.3 .
>
> For this i plan to use the OSDB 0.14  and compare the results for both 
> the
> cases.
>
> Does any one has suggestions for comparing 7.4 against 7.3 ?
> Since i am using OSDB for second time only any tips/guidance
> on usage of that is also appreciated.
>
>
>
> H/W config:
>
> CPU: 4 X Intel(R) Xeon(TM) CPU 2.00GHz
> MEM : 2 GB
> I/O config : PGDATA on 10000 RPM Ultra160 scsi , pg_xlog on a similar
> seperate SCSI
>
> GUC:
> shared_buffers = 10000
> max_fsm_relations = 5000
> max_fsm_pages = 55099264
> sort_mem = 16384
> vacuum_mem = 8192
>
> All other performance related parameter have default
> value eg:
>
> #effective_cache_size = 1000    # typically 8KB each
> #random_page_cost = 4           # units are one sequential page fetch 
> cost
> #cpu_tuple_cost = 0.01          # (same)
> #cpu_index_tuple_cost = 0.001   # (same)
> #cpu_operator_cost = 0.0025     # (same)
>
>
>
> BTW i get following error at the moment:
> -----------------------------------------
> /usr/local/bin/osdb-pg-ui --postgresql=no_hash_index
> "osdb"
> "Invoked: /usr/local/bin/osdb-pg-ui --postgresql=no_hash_index"
>
>                  create_tables()        0.78 seconds    return value = 0
>                           load()        1.02 seconds    return value = 0
>      create_idx_uniques_key_bt()        0.64 seconds    return value = 0
>      create_idx_updates_key_bt()        0.61 seconds    return value = 0
>      create_idx_hundred_key_bt()        0.61 seconds    return value = 0
>       create_idx_tenpct_key_bt()        0.62 seconds    return value = 0
>  create_idx_tenpct_key_code_bt()        0.45 seconds    return value = 0
>         create_idx_tiny_key_bt()        0.46 seconds    return value = 0
>       create_idx_tenpct_int_bt()        0.46 seconds    return value = 0
>    create_idx_tenpct_signed_bt()        0.45 seconds    return value = 0
>      create_idx_uniques_code_h()        0.46 seconds    return value = 0
>    create_idx_tenpct_double_bt()        0.46 seconds    return value = 0
>    create_idx_updates_decim_bt()        0.45 seconds    return value = 0
>     create_idx_tenpct_float_bt()        0.46 seconds    return value = 0
>      create_idx_updates_int_bt()        0.46 seconds    return value = 0
>     create_idx_tenpct_decim_bt()        0.46 seconds    return value = 0
>      create_idx_hundred_code_h()        0.45 seconds    return value = 0
>       create_idx_tenpct_name_h()        0.46 seconds    return value = 0
>      create_idx_updates_code_h()        0.46 seconds    return value = 0
>       create_idx_tenpct_code_h()        0.45 seconds    return value = 0
>   create_idx_updates_double_bt()        0.46 seconds    return value = 0
>     create_idx_hundred_foreign()        0.41 seconds    return value = 0
>               populateDataBase()        11.54 seconds   return value = 0
>
> Error in test Counting tuples at (6746)osdb.c:294:
> ... empty database -- empty results
> perror() reports: Resource temporarily unavailable
>
> someone sighup'd the parent
>
> Any clue?
>
> ------------------------------------------
>
>
> Regards
> Mallah.
>
>
>
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
>               http://www.postgresql.org/docs/faqs/FAQ.html






^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Suggestions for benchmarking 7.4RC2 against 7.3
  2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-12 15:04 ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
@ 2003-11-11 18:08   ` Christopher Browne <cbbrowne@acm.org>
  2003-11-11 18:25     ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Josh Berkus <josh@agliodbs.com>
  2003-11-12 21:25     ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  0 siblings, 2 replies; 6+ messages in thread

From: Christopher Browne @ 2003-11-11 18:08 UTC (permalink / raw)
  To: pgsql-performance

After a long battle with technology,mallah@trade-india.com (Rajesh Kumar Mallah), an earthling, wrote:
> the error mentioned in first email has been overcome
> by running osdb on the same machine hosting the DB server.

Yes, it seems unrealistic to try to run the "client" on a separate
host from the database.  

I got the osdb benchmark running last week, and had to separate client
from server.  I had to jump through a fair number of hoops including
copying data files over to the server.  The benchmark software needs a
bit more work...
-- 
let name="cbbrowne" and tld="cbbrowne.com" in String.concat "@" [name;tld];;
http://cbbrowne.com/info/lsf.html
Nobody can fix the economy.  Nobody can be trusted with their finger
on the button.  Nobody's perfect.  VOTE FOR NOBODY.



^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Suggestions for benchmarking 7.4RC2 against 7.3
  2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-12 15:04 ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-11 18:08   ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Christopher Browne <cbbrowne@acm.org>
@ 2003-11-11 18:25     ` Josh Berkus <josh@agliodbs.com>
  2003-11-12 20:16       ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  1 sibling, 1 reply; 6+ messages in thread

From: Josh Berkus @ 2003-11-11 18:25 UTC (permalink / raw)
  To: Christopher Browne <cbbrowne@acm.org>; pgsql-performance

Rajesh, Chris,

> I got the osdb benchmark running last week, and had to separate client
> from server.  I had to jump through a fair number of hoops including
> copying data files over to the server.  The benchmark software needs a
> bit more work...

What about the OSDL's TPC-derivative benchmarks?   That's a much more 
respected database test, and probably less buggy than OSDB.

-- 
Josh Berkus
Aglio Database Solutions
San Francisco



^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Suggestions for benchmarking 7.4RC2 against 7.3
  2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-12 15:04 ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-11 18:08   ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Christopher Browne <cbbrowne@acm.org>
  2003-11-11 18:25     ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Josh Berkus <josh@agliodbs.com>
@ 2003-11-12 20:16       ` Rajesh Kumar Mallah <mallah@trade-india.com>
  0 siblings, 0 replies; 6+ messages in thread

From: Rajesh Kumar Mallah @ 2003-11-12 20:16 UTC (permalink / raw)
  To: Josh Berkus <josh@agliodbs.com>; +Cc: Christopher Browne <cbbrowne@acm.org>; pgsql-performance

Josh Berkus wrote:

>Rajesh, Chris,
>
>  
>
>>I got the osdb benchmark running last week, and had to separate client
>>from server.  I had to jump through a fair number of hoops including
>>copying data files over to the server.  The benchmark software needs a
>>bit more work...
>>    
>>
>
>What about the OSDL's TPC-derivative benchmarks?   That's a much more 
>respected database test, and probably less buggy than OSDB.
>
>  
>
Hmm... really sorry! my
pg_dump | psql is almost finishing in next 20 mins.

creating indexes at the moment :)

Really sorry can't rollback and delay anymore becoz my
website is *unavailable* for past 30 mins.

I ran OSDB .15 version  and pg_bench .


Regds
Mallah.

^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: Suggestions for benchmarking 7.4RC2 against 7.3
  2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-12 15:04 ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
  2003-11-11 18:08   ` Re: Suggestions for benchmarking 7.4RC2 against 7.3 Christopher Browne <cbbrowne@acm.org>
@ 2003-11-12 21:25     ` Rajesh Kumar Mallah <mallah@trade-india.com>
  1 sibling, 0 replies; 6+ messages in thread

From: Rajesh Kumar Mallah @ 2003-11-12 21:25 UTC (permalink / raw)
  To: Christopher Browne <cbbrowne@acm.org>; +Cc: pgsql-performance

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1">
  <title></title>
</head>
<body text="#000000" bgcolor="#ffffff">
<br>
<br>
RC2 is running in production without any apparent problems<br>
till now.&nbsp; Well its difficult to say at the moment how much speed<br>
gain is there unless the heavy duty batch SQL scripts are run by<br>
cron. <br>
<br>
Count(*) and group by on large tables are significantly (5x) faster<br>
and better error reporting has made it easier to spot the faulty data.<br>
eg in fkey violation.<br>
<br>
Will post the OSDB .15 versions' results on 7.3 &amp; 7.4 soon.<br>
<br>
Regds<br>
Mallah.<br>
<br>
Christopher Browne wrote:<br>
<blockquote type="cite" cite="midm34qxau6bb.fsf@wolfe.cbbrowne.com">
  <pre wrap="">After a long battle with technology,<a class="moz-txt-link-abbreviated" href="mailto:mallah@trade-india.com">mallah@trade-india.com</a> (Rajesh Kumar Mallah), an earthling, wrote:
  </pre>
  <blockquote type="cite">
    <pre wrap="">the error mentioned in first email has been overcome
by running osdb on the same machine hosting the DB server.
    </pre>
  </blockquote>
  <pre wrap=""><!---->
Yes, it seems unrealistic to try to run the "client" on a separate
host from the database.  

I got the osdb benchmark running last week, and had to separate client
from server.  I had to jump through a fair number of hoops including
copying data files over to the server.  The benchmark software needs a
bit more work...
  </pre>
</blockquote>
<br>
</body>
</html>




^ permalink  raw  reply  [nested|flat] 6+ messages in thread


end of thread, other threads:[~2003-11-12 21:25 UTC | newest]

Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-11-12 14:47 Suggestions for benchmarking 7.4RC2 against 7.3 Rajesh Kumar Mallah <mallah@trade-india.com>
2003-11-12 15:04 ` Rajesh Kumar Mallah <mallah@trade-india.com>
2003-11-11 18:08   ` Christopher Browne <cbbrowne@acm.org>
2003-11-11 18:25     ` Josh Berkus <josh@agliodbs.com>
2003-11-12 20:16       ` Rajesh Kumar Mallah <mallah@trade-india.com>
2003-11-12 21:25     ` Rajesh Kumar Mallah <mallah@trade-india.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox