pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Benchmark
26+ messages / 20 participants
[nested] [flat]

* Benchmark
@ 2003-08-15 06:33 mixo <mixo@coza.net.za>
  2003-08-15 09:32 ` Re: Benchmark Tomka Gergely <tomka@zeus.gau.hu>
  2003-08-15 13:12 ` Re: Benchmark Richard Huxton <dev@archonet.com>
  2003-08-15 16:21 ` Re: Benchmark Josh Berkus <josh@agliodbs.com>
  2003-08-15 18:47 ` Re: Benchmark Balazs Wellisch <balazs@neusolutions.com>
  0 siblings, 4 replies; 26+ messages in thread

From: mixo @ 2003-08-15 06:33 UTC (permalink / raw)
  To: pgsql-performance

I have the following setup :
  Apache 2 + mod_perl 2
  Postgres 7.3.2

I need to is measure the perfomance of a ticketing system (written in perl)
which has web interface (html::mason, apache2) with Pg as a backend. Users
of the ticketing system can only connect to the backend via the web 
interface
and they usually login to the system at the begining of the the day and 
remain
connected untill they knock of. I have setup two test machines, one with Pg
and the other with Mysql. Both machine have the same data (sample).

I am looking for a benchmark utilty that the simulate a user session.
For example, a user login in, displaying a ticket and searching for tickets;
all these invlove a user connecting to the a url, like for search, a 
user needs
to open "somehost.domain/path/to/search.html?with=arguments". The 
utiltly needs
to simulate these actions.

The following tools currently have so far caught my attention:
   Apache Jmeter
   ab

I need suggestions for other utilities.





^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
@ 2003-08-15 09:32 ` Tomka Gergely <tomka@zeus.gau.hu>
  3 siblings, 0 replies; 26+ messages in thread

From: Tomka Gergely @ 2003-08-15 09:32 UTC (permalink / raw)
  To: mixo <mixo@coza.net.za>; +Cc: pgsql-performance

2003-08-15 ragyogó napján mixo ezt üzente:

> For example, a user login in, displaying a ticket and searching for tickets;
> all these invlove a user connecting to the a url, like for search, a
> user needs
> to open "somehost.domain/path/to/search.html?with=arguments". The
> utiltly needs
> to simulate these actions.

Maybe a simple script, with lines like this:
#!/bin/bash
wget http://somehost.domain/path/to/search.html?with=arguments
wget http://somehost.domain/another/script.html
...

?

-- 
Tomka Gergely
"S most - vajon barbárok nélkül mi lesz velünk?
Ők mégiscsak megoldás voltak valahogy..."




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
@ 2003-08-15 13:12 ` Richard Huxton <dev@archonet.com>
  2003-08-15 18:24   ` Re: Benchmark Jeff <threshar@torgo.978.org>
  3 siblings, 1 reply; 26+ messages in thread

From: Richard Huxton @ 2003-08-15 13:12 UTC (permalink / raw)
  To: mixo@coza.net.za; pgsql-performance

On Friday 15 August 2003 07:33, mixo wrote:
> I have the following setup :
>   Apache 2 + mod_perl 2
>   Postgres 7.3.2
>

> I am looking for a benchmark utilty that the simulate a user session.
> For example, a user login in, displaying a ticket and searching for
> tickets; all these invlove a user connecting to the a url, like for search,
> a user needs
> to open "somehost.domain/path/to/search.html?with=arguments". The
> utiltly needs
> to simulate these actions.
>
> The following tools currently have so far caught my attention:
>    Apache Jmeter
>    ab

Depending on how complex things are, you may be able to use Tomka's suggestion 
of a batch of wget commands.

However, if you want to be able to fill in forms, handle cookies and react to 
results you might want to look at something based on Perl's LWP bundle 
(LWP::UserAgent is a good start point).

If you want to see how many users can be supported, don't forget to include 
plausible delays in the test sequence where the users would be 
reading/entering data.

If you do find some flexible, scriptable web testing system that can read/fill 
out forms etc please post to the list - I've had no luck finding anything I 
like.

-- 
  Richard Huxton
  Archonet Ltd



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
  2003-08-15 13:12 ` Re: Benchmark Richard Huxton <dev@archonet.com>
@ 2003-08-15 18:24   ` Jeff <threshar@torgo.978.org>
  0 siblings, 0 replies; 26+ messages in thread

From: Jeff @ 2003-08-15 18:24 UTC (permalink / raw)
  To: Richard Huxton <dev@archonet.com>; +Cc: mixo@coza.net.za <mixo@coza.net.za>; pgsql-performance

On Fri, 15 Aug 2003, Richard Huxton wrote:

> If you do find some flexible, scriptable web testing system that can read/fill
> out forms etc please post to the list - I've had no luck finding anything I
> like.
>
There was a tool created by altavista R&D called "WebL" that I used on a
project.  I think if you search around you'll be able to find it.

However, I think it has developed "bit rot" from not being touched in so
long. My old webl stuff will no longer work.

But what is it?  it is a web scraping language written in java. Fast it is
not. Easy to scrape and interact with pages: YES.  It has all sorts of
things for locating fields, locating table cells, etc.  (I used it for
writing a prototype that would scrape a competitors site and import the
data into our application :)

but if it doesn't work LWP isn't _that_ bad. You will end up in regex hell
though.

--
Jeff Trout <jeff@jefftrout.com>
http://www.jefftrout.com/
http://www.stuarthamm.net/





^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
@ 2003-08-15 16:21 ` Josh Berkus <josh@agliodbs.com>
  2003-08-17 03:48   ` Re: Benchmark David Emery <dave@skiddlydee.com>
  3 siblings, 1 reply; 26+ messages in thread

From: Josh Berkus @ 2003-08-15 16:21 UTC (permalink / raw)
  To: mixo@coza.net.za; pgsql-performance

Mixo,

> I need to is measure the perfomance of a ticketing system (written in perl)
> which has web interface (html::mason, apache2) with Pg as a backend. Users
> of the ticketing system can only connect to the backend via the web
> interface

I'd suggest Perl LWP.  There's even a good article on how to use it in last 
month's Linux Magazine (or the previous month, not sure).  

Don't forget to come back here for help in tweaking your PostgreSQL settings!

-- 
Josh Berkus
Aglio Database Solutions
San Francisco



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
  2003-08-15 16:21 ` Re: Benchmark Josh Berkus <josh@agliodbs.com>
@ 2003-08-17 03:48   ` David Emery <dave@skiddlydee.com>
  0 siblings, 0 replies; 26+ messages in thread

From: David Emery @ 2003-08-17 03:48 UTC (permalink / raw)
  To: mixo@coza.net.za; +Cc: pgsql-performance


On Saturday, August 16, 2003, at 01:21 AM, Josh Berkus wrote:

> Mixo,
>
>> I need to is measure the perfomance of a ticketing system (written in  
>> perl)
>> which has web interface (html::mason, apache2) with Pg as a backend.  
>> Users
>> of the ticketing system can only connect to the backend via the web
>> interface
>
> I'd suggest Perl LWP.  There's even a good article on how to use it in  
> last
> month's Linux Magazine (or the previous month, not sure).
>

The Perl module HTTP::WebTest should help you do what you want.

http://search.cpan.org/author/ILYAM/HTTP-WebTest-2.03/lib/HTTP/ 
WebTest.pm

It should save a ton of time over building one from scratch. Lots of  
docs too. There are other Perl web testing tools too if you do a search  
at:

http://search.cpan.org

HTH,
Dave




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
@ 2003-08-15 18:47 ` Balazs Wellisch <balazs@neusolutions.com>
  3 siblings, 0 replies; 26+ messages in thread

From: Balazs Wellisch @ 2003-08-15 18:47 UTC (permalink / raw)
  To: pgsql-performance

You might want to check out these links:

http://www.loadtestingtool.com/download.html
http://www.opensta.org/
http://www.microsoft.com/technet/treeview/default.asp?url=/TechNet/itsol
utions/intranet/downloads/webstres.asp?frame=true
http://www.softwareqatest.com/qatweb1.html


Balazs



-----Original Message-----
From: pgsql-performance-owner@postgresql.org
[mailto:pgsql-performance-owner@postgresql.org] On Behalf Of mixo
Sent: Thursday, August 14, 2003 11:34 PM
To: pgsql-performance@postgresql.org
Subject: [PERFORM] Benchmark

I have the following setup :
  Apache 2 + mod_perl 2
  Postgres 7.3.2

I need to is measure the perfomance of a ticketing system (written in
perl)
which has web interface (html::mason, apache2) with Pg as a backend.
Users
of the ticketing system can only connect to the backend via the web 
interface
and they usually login to the system at the begining of the the day and 
remain
connected untill they knock of. I have setup two test machines, one with
Pg
and the other with Mysql. Both machine have the same data (sample).

I am looking for a benchmark utilty that the simulate a user session.
For example, a user login in, displaying a ticket and searching for
tickets;
all these invlove a user connecting to the a url, like for search, a 
user needs
to open "somehost.domain/path/to/search.html?with=arguments". The 
utiltly needs
to simulate these actions.

The following tools currently have so far caught my attention:
   Apache Jmeter
   ab

I need suggestions for other utilities.



---------------------------(end of broadcast)---------------------------
TIP 2: you can get off all lists at once with the unregister command
    (send "unregister YourEmailAddressHere" to majordomo@postgresql.org)





^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Benchmark
@ 2005-02-10 05:49 Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  0 siblings, 1 reply; 26+ messages in thread

From: Jaime Casanova @ 2005-02-10 05:49 UTC (permalink / raw)
  To: pgsql-performance

Hi guys,

i'm planning try to do a comparative between some DBMS
and postgresql (informix, oracle, m$ sql server,
firebird and even mysql) i'm coordinating with people
in the irc spanish postgresql channel.

1) maybe can anyone give me suggestions on this?
2) point me to a good benchmark test or script that
can be used?
3) any comments?

regards,
Jaime Casanova

_________________________________________________________
Do You Yahoo!?
Información de Estados Unidos y América Latina, en Yahoo! Noticias.
Visítanos en http://noticias.espanol.yahoo.com



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
@ 2005-02-10 13:21 ` Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  0 siblings, 1 reply; 26+ messages in thread

From: Jeff @ 2005-02-10 13:21 UTC (permalink / raw)
  To: Jaime Casanova <systemguards@yahoo.com>; +Cc: pgsql-performance


On Feb 10, 2005, at 12:49 AM, Jaime Casanova wrote:

> Hi guys,
>
> i'm planning try to do a comparative between some DBMS
> and postgresql (informix, oracle, m$ sql server,
> firebird and even mysql) i'm coordinating with people
> in the irc spanish postgresql channel.
>
> 2) point me to a good benchmark test or script that
> can be used?

The TPC tests are fairly widely accepted.  The thing with a benchmark 
is they are unlikely to simulate your real traffic.  But it is always 
fun to look at numbers

> 3) any comments?
>

If you plan on making your results public be very careful with the 
license agreements on the other db's.  I know Oracle forbids the 
release of benchmark numbers without their approval.

--
Jeff Trout <jeff@jefftrout.com>
http://www.jefftrout.com/
http://www.stuarthamm.net/




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
@ 2005-02-11 05:22   ` Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 18:09     ` Re: Benchmark Mike Benoit <ipso@snappymail.ca>
  0 siblings, 2 replies; 26+ messages in thread

From: Mitch Pirtle @ 2005-02-11 05:22 UTC (permalink / raw)
  To: pgsql-performance

On Thu, 10 Feb 2005 08:21:09 -0500, Jeff <threshar@torgo.978.org> wrote:
> 
> If you plan on making your results public be very careful with the
> license agreements on the other db's.  I know Oracle forbids the
> release of benchmark numbers without their approval.

...as all of the other commercial databases do. This may be off-topic,
but has anyone actually suffered any consequences of a published
benchmark without permission?

For example, I am a developer of Mambo, a PHP-based CMS application,
and am porting the mysql functions to ADOdb so I can use grown-up
databases ;-)

What is keeping me from running a copy of Mambo on a donated server
for testing and performance measures (including the commercial
databases) and then publishing the results based on Mambo's
performance on each?

It would be really useful to know if anyone has ever been punished for
doing this, as IANAL but that restriction is going to be very, VERY
difficult to back up in court without precedence. Is this just a
deterrent, or is it real?

-- Mitch



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
@ 2005-02-11 06:38     ` Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:04       ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 07:22       ` Re: Benchmark Jaime Casanova <systemguards@gmail.com>
  1 sibling, 2 replies; 26+ messages in thread

From: Tom Lane @ 2005-02-11 06:38 UTC (permalink / raw)
  To: Mitch Pirtle <mitch.pirtle@gmail.com>; +Cc: pgsql-performance

Mitch Pirtle <mitch.pirtle@gmail.com> writes:
> It would be really useful to know if anyone has ever been punished for
> doing this, as IANAL but that restriction is going to be very, VERY
> difficult to back up in court without precedence. Is this just a
> deterrent, or is it real?

If Oracle doesn't eat your rear for lunch, it would only be because you
hadn't annoyed them sufficiently for them to bother.  Under the terms of
the license agreement that you presumably clicked through, you gave up
your rights to publish anything they don't like.  Do a little Google
research.  For instance
http://www.infoworld.com/articles/op/xml/01/04/16/010416opfoster.html

The impression I get is that if you are willing to spend lots of $$
you could *maybe* win the case, if you can still find a judge who thinks
that the public good outweighs private contract law (good luck, with the
Republicans in office).  Do you have a larger budget for legal issues
than Oracle does?  If so, step right up.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
@ 2005-02-11 07:04       ` Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 13:20         ` Re: Benchmark Jeff <threshar@torgo.978.org>
  1 sibling, 1 reply; 26+ messages in thread

From: Mitch Pirtle @ 2005-02-11 07:04 UTC (permalink / raw)
  To: pgsql-performance

On Fri, 11 Feb 2005 01:38:13 -0500, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> 
> If Oracle doesn't eat your rear for lunch, 

That would be more like an appetizer at a california cuisine place.

> it would only be because you
> hadn't annoyed them sufficiently for them to bother.  Under the terms of
> the license agreement that you presumably clicked through, you gave up
> your rights to publish anything they don't like.  Do a little Google
> research.  For instance
> http://www.infoworld.com/articles/op/xml/01/04/16/010416opfoster.html

I did do the research, but couldn't find one instance where someone
was actually taken to task over it. So far it appears to be bluster.
Horrifying to some, but still bluster.

> The impression I get is that if you are willing to spend lots of $$
> you could *maybe* win the case, if you can still find a judge who thinks
> that the public good outweighs private contract law (good luck, with the
> Republicans in office).  Do you have a larger budget for legal issues
> than Oracle does?  If so, step right up.

The reason I asked is because this has a lot more to do with than just
money. This is restriction of speech as well, and publishing
benchmarks (simply as statistical data) cannot in any way be construed
as defamation or libel. Just because it is in the click-wrap contract
doesn't mean you waive certain rights, and this has been proven (and
now has precedence). Again, I would love to know of any instances
where someone published (forbidden) benchmarks and was actually
pursued in a court of law. Well, and the result, too ;-)

I ask not to cause trouble, but to learn if this is just a deterrent
that has never been tested ("small pebble") or a well-defined threat
that will be enforced ("plasma cannon").

-- Mitch, thinking this is off topic but still fascinating



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:04       ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
@ 2005-02-11 13:20         ` Jeff <threshar@torgo.978.org>
  2005-02-11 15:04           ` Re: Benchmark Greg Stark <gsstark@mit.edu>
  0 siblings, 1 reply; 26+ messages in thread

From: Jeff @ 2005-02-11 13:20 UTC (permalink / raw)
  To: Mitch Pirtle <mitch.pirtle@gmail.com>; +Cc: pgsql-performance


On Feb 11, 2005, at 2:04 AM, Mitch Pirtle wrote:
>
> I did do the research, but couldn't find one instance where someone
> was actually taken to task over it. So far it appears to be bluster.
> Horrifying to some, but still bluster.
>

They may not have done that yet, but they _COULD_.  And if they decide 
to they have more money and power than you likely have and would drive 
you into financial ruin for the rest of your life (Even if you are 
correct).   It is a big risk.  I think that clause is in there so MS, 
etc. can't say "Use FooSQL, its 428% faster than that Oracle POS Just 
look!"

After using oracle in the last few months..  I can see why they'd want 
to prevent those numbers.. Oracle really isn't that good.  I had been 
under the impression that it was holy smokes amazingly fast.  It just 
isn't.  At least, in my experience it isn't.  but that is another 
story.

--
Jeff Trout <jeff@jefftrout.com>
http://www.jefftrout.com/
http://www.stuarthamm.net/




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:04       ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 13:20         ` Re: Benchmark Jeff <threshar@torgo.978.org>
@ 2005-02-11 15:04           ` Greg Stark <gsstark@mit.edu>
  2005-02-11 18:32             ` Re: Benchmark PFC <lists@boutiquenumerique.com>
  0 siblings, 1 reply; 26+ messages in thread

From: Greg Stark @ 2005-02-11 15:04 UTC (permalink / raw)
  To: Jeff <threshar@torgo.978.org>; +Cc: Mitch Pirtle <mitch.pirtle@gmail.com>; pgsql-performance

Jeff <threshar@torgo.978.org> writes:

> After using oracle in the last few months..  I can see why they'd want to
> prevent those numbers.. Oracle really isn't that good.  I had been under the
> impression that it was holy smokes amazingly fast.  It just isn't.  At least,
> in my experience it isn't.  but that is another story.

Oracle's claim to performance comes not from tight coding and low overhead.
For that you use Mysql :)

Oracle's claim to performance comes from how you can throw it at a machine
with 4-16 processors and it really does get 4-16x as fast. Features like
partitioned tables, parallel query, materialized views, etc make it possible
to drive it further up the performance curve than Sybase/MSSQL or Postgres.

In terms of performance, Oracle is to Postgres as Postgres is to Mysql: More
complexity, more overhead, more layers of abstraction, but in the long run it
pays off when you need it. (Only without the user-friendliness of either
open-source softwares.)

-- 
greg




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:04       ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 13:20         ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 15:04           ` Re: Benchmark Greg Stark <gsstark@mit.edu>
@ 2005-02-11 18:32             ` PFC <lists@boutiquenumerique.com>
  0 siblings, 0 replies; 26+ messages in thread

From: PFC @ 2005-02-11 18:32 UTC (permalink / raw)
  To: pgsql-performance


> In terms of performance, Oracle is to Postgres as Postgres is to Mysql:  
> More
> complexity, more overhead, more layers of abstraction, but in the long  
> run it
> pays off when you need it. (Only without the user-friendliness of either
> open-source softwares.)
>

	I don't find postgres complex... I find it nice, well-behaved, very easy  
to use, very powerful, user-friendly... there are a lot of features but  
somehow it's well integrated and makes a coherent set. It also has some  
very useful secret passages (like the whole GiST family) which can save  
you from some things at which SQL really sucks. It certainly is complex on  
the inside but I think the devs have done a very good job at hiding that.

	It's also polite : it will say 'I have a function with the name you said  
but the parameter types don't match' ; mysql will just say 'syntax error,  
RTFM', or insert its favorite value of 0.



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
@ 2005-02-11 07:22       ` Jaime Casanova <systemguards@gmail.com>
  2005-02-11 13:08         ` Re: Benchmark Bruno Wolff III <bruno@wolff.to>
  1 sibling, 1 reply; 26+ messages in thread

From: Jaime Casanova @ 2005-02-11 07:22 UTC (permalink / raw)
  To: pgsql-performance

On Fri, 11 Feb 2005 01:38:13 -0500, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> Mitch Pirtle <mitch.pirtle@gmail.com> writes:
> > It would be really useful to know if anyone has ever been punished for
> > doing this, as IANAL but that restriction is going to be very, VERY
> > difficult to back up in court without precedence. Is this just a
> > deterrent, or is it real?
> 
> If Oracle doesn't eat your rear for lunch, it would only be because you
> hadn't annoyed them sufficiently for them to bother.  Under the terms of
> the license agreement that you presumably clicked through, you gave up
> your rights to publish anything they don't like.  Do a little Google
> research.  For instance
> http://www.infoworld.com/articles/op/xml/01/04/16/010416opfoster.html
> 
What about the free speech rigths, in USA they are in the constitution
and cannot be denied or revoked, IANAL.

And like stated by Mitch just numbers are not lies that can be pursued
in a court of law.

Think anout it, In USA you can speak and publish about the President
but cannot say anything about M$ or Oracles' DBMS?

regards,
Jaime Casanova



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:22       ` Re: Benchmark Jaime Casanova <systemguards@gmail.com>
@ 2005-02-11 13:08         ` Bruno Wolff III <bruno@wolff.to>
  2005-02-11 13:16           ` Re: Benchmark Richard Huxton <dev@archonet.com>
  0 siblings, 1 reply; 26+ messages in thread

From: Bruno Wolff III @ 2005-02-11 13:08 UTC (permalink / raw)
  To: Jaime Casanova <systemguards@gmail.com>; +Cc: pgsql-performance

On Fri, Feb 11, 2005 at 02:22:39 -0500,
  Jaime Casanova <systemguards@gmail.com> wrote:
> What about the free speech rigths, in USA they are in the constitution
> and cannot be denied or revoked, IANAL.

You can voluntarily give up your rights to free speech in the US.

> And like stated by Mitch just numbers are not lies that can be pursued
> in a court of law.

I think part of the reason they don't want people doing this, is because
if you don't configure their database well, you can make it look bad
when it shouldn't.

> Think anout it, In USA you can speak and publish about the President
> but cannot say anything about M$ or Oracles' DBMS?

Not if you signed a contract that says you can't.

If you didn't actually sign an agreement saying you wouldn't publish
benchmarks, then you might have a case. You might argue that a click
through eula isn't a valid contract or that you are a third party
who isn't bound by whatever agreement the person who installed Oracle
made. However it probably would cost you a bundle to have a chance
at winning.



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 06:38     ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-11 07:22       ` Re: Benchmark Jaime Casanova <systemguards@gmail.com>
  2005-02-11 13:08         ` Re: Benchmark Bruno Wolff III <bruno@wolff.to>
@ 2005-02-11 13:16           ` Richard Huxton <dev@archonet.com>
  0 siblings, 0 replies; 26+ messages in thread

From: Richard Huxton @ 2005-02-11 13:16 UTC (permalink / raw)
  To: Bruno Wolff III <bruno@wolff.to>; +Cc: Jaime Casanova <systemguards@gmail.com>; pgsql-performance

Bruno Wolff III wrote:
> On Fri, Feb 11, 2005 at 02:22:39 -0500,
>   Jaime Casanova <systemguards@gmail.com> wrote:
> 
>>Think anout it, In USA you can speak and publish about the President
>>but cannot say anything about M$ or Oracles' DBMS?
> 
> 
> Not if you signed a contract that says you can't.
> 
> If you didn't actually sign an agreement saying you wouldn't publish
> benchmarks, then you might have a case. You might argue that a click
> through eula isn't a valid contract or that you are a third party
> who isn't bound by whatever agreement the person who installed Oracle
> made. However it probably would cost you a bundle to have a chance
> at winning.

IANAL etc, but the key fear is more likely that Oracle merely cancel 
your licence(s). And deny you any more. And prevent your software from 
running on top of Oracle. At which point, you have to sue Oracle and 
prove restraint of trade or unfair competition or similar. Don't forget 
that you have no right to purchase Oracle licences, they are free to 
sell to whoever they choose and under whatever conditions.

--
   Richard Huxton
   Archonet Ltd



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
@ 2005-02-11 18:09     ` Mike Benoit <ipso@snappymail.ca>
  2005-02-11 18:41       ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
  1 sibling, 1 reply; 26+ messages in thread

From: Mike Benoit @ 2005-02-11 18:09 UTC (permalink / raw)
  To: Mitch Pirtle <mitch.pirtle@gmail.com>; +Cc: pgsql-performance

I have never used Oracle myself, nor have I read its license agreement,
but what if you didn't name Oracle directly? ie:

TPS		Database
-------------------------------
112	MySQL
120	PgSQL
90	Sybase
95	"Other database that *may* start with a letter after N"
50	"Other database that *may* start with a letter after L"

As far as I know there are only a couple databases that don't allow you
to post benchmarks, but if they remain "unnamed" can legal action be
taken? 

Just like all those commercials on TV where they advertise: "Cleans 10x
better then the other leading brand".


On Fri, 2005-02-11 at 00:22 -0500, Mitch Pirtle wrote:
> On Thu, 10 Feb 2005 08:21:09 -0500, Jeff <threshar@torgo.978.org> wrote:
> > 
> > If you plan on making your results public be very careful with the
> > license agreements on the other db's.  I know Oracle forbids the
> > release of benchmark numbers without their approval.
> 
> ...as all of the other commercial databases do. This may be off-topic,
> but has anyone actually suffered any consequences of a published
> benchmark without permission?
> 
> For example, I am a developer of Mambo, a PHP-based CMS application,
> and am porting the mysql functions to ADOdb so I can use grown-up
> databases ;-)
> 
> What is keeping me from running a copy of Mambo on a donated server
> for testing and performance measures (including the commercial
> databases) and then publishing the results based on Mambo's
> performance on each?
> 
> It would be really useful to know if anyone has ever been punished for
> doing this, as IANAL but that restriction is going to be very, VERY
> difficult to back up in court without precedence. Is this just a
> deterrent, or is it real?
> 
> -- Mitch
> 
> ---------------------------(end of broadcast)---------------------------
> TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org
-- 
Mike Benoit <ipso@snappymail.ca>

Attachments:

  signature.asc (application/pgp-signature, 188B) download

^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 18:09     ` Re: Benchmark Mike Benoit <ipso@snappymail.ca>
@ 2005-02-11 18:41       ` Tom Lane <tgl@sss.pgh.pa.us>
  2005-02-13 09:21         ` Re: Benchmark Ron Mayer <rm_pg@cheapcomplexdevices.com>
  0 siblings, 1 reply; 26+ messages in thread

From: Tom Lane @ 2005-02-11 18:41 UTC (permalink / raw)
  To: Mike Benoit <ipso@snappymail.ca>; +Cc: Mitch Pirtle <mitch.pirtle@gmail.com>; pgsql-performance

Mike Benoit <ipso@snappymail.ca> writes:
> I have never used Oracle myself, nor have I read its license agreement,
> but what if you didn't name Oracle directly? ie:

> TPS		Database
> -------------------------------
> 112	MySQL
> 120	PgSQL
> 90	Sybase
> 95	"Other database that *may* start with a letter after N"
> 50	"Other database that *may* start with a letter after L"

Great Bridge did essentially that years ago, but I think we only got
away with it because we didn't say which DBs "Commercial Database A"
and "Commercial Database B" actually were.  Even off the record, we
were only allowed to tell people that the commercial DBs were Oracle
and SQL Server ... but not which was which.

			regards, tom lane



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
  2005-02-10 13:21 ` Re: Benchmark Jeff <threshar@torgo.978.org>
  2005-02-11 05:22   ` Re: Benchmark Mitch Pirtle <mitch.pirtle@gmail.com>
  2005-02-11 18:09     ` Re: Benchmark Mike Benoit <ipso@snappymail.ca>
  2005-02-11 18:41       ` Re: Benchmark Tom Lane <tgl@sss.pgh.pa.us>
@ 2005-02-13 09:21         ` Ron Mayer <rm_pg@cheapcomplexdevices.com>
  0 siblings, 0 replies; 26+ messages in thread

From: Ron Mayer @ 2005-02-13 09:21 UTC (permalink / raw)
  To: Ron Mayer <rm_pg@cheapcomplexdevices.com>; pgsql-performance

Tom Lane wrote:
> Great Bridge did essentially that years ago, but I think we only got
> away with it because we didn't say which DBs "Commercial Database A"
> and "Commercial Database B" actually were.  Even off the record, we
> were only allowed to tell people that the commercial DBs were Oracle
> and SQL Server ... but not which was which.

IMHO clues like:

  "What versions of the databases did you use?
  - PostgreSQL - 7.0 release version
  - Proprietary 1 - 8.1.5
  - Proprietary 2 - 7.0
  - MySQL - 3.22.32
  - Interbase - 6.0
  "
and
  "PostgreSQL" and "Proprietary 1" was running "red hat linux 6.1" and
  "Proprietary 2" was running Windows NT server 4 - service pack 4"
in articles like this one: http://www.xperts.com/news/press1.htm

helped some people narrow it down a bit.  :)




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
@ 2005-02-11 20:41 Merlin Moncure <merlin.moncure@rcsonline.com>
  2005-02-13 01:34 ` Re: Benchmark Christopher Browne <cbbrowne@acm.org>
  0 siblings, 1 reply; 26+ messages in thread

From: Merlin Moncure @ 2005-02-11 20:41 UTC (permalink / raw)
  To: Mike Benoit <ipso@snappymail.ca>; +Cc: pgsql-performance

> I have never used Oracle myself, nor have I read its license
agreement,
> but what if you didn't name Oracle directly? ie:
> 
> TPS		Database
> -------------------------------
> 112	MySQL
> 120	PgSQL
> 90	Sybase
> 95	"Other database that *may* start with a letter after N"
> 50	"Other database that *may* start with a letter after L"
> 
> As far as I know there are only a couple databases that don't allow
you
> to post benchmarks, but if they remain "unnamed" can legal action be
> taken?
> 
> Just like all those commercials on TV where they advertise: "Cleans
10x
> better then the other leading brand".

Instead of measuring transactions/second, let's put everything in terms
of transactions/dollar.  This will make it quite easy to determine which
database is which from the results.  Since postgresql is free and would
invalidate our test on mathematical terms, we will sub in the $19.99
price of a T-Shirt (http://www.sourcewear.com/) for the price of the
database.

TP$		Database
-------------------------------
25          A
.5          B
.01         C
.001        D
.00001      E

Merlin



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-11 20:41 Re: Benchmark Merlin Moncure <merlin.moncure@rcsonline.com>
@ 2005-02-13 01:34 ` Christopher Browne <cbbrowne@acm.org>
  2005-02-13 16:34   ` Re: Benchmark Greg Stark <gsstark@mit.edu>
  2005-02-13 19:24   ` Re: Benchmark Patrick Meylemans <Patrick.Meylemans@wtcm.be>
  0 siblings, 2 replies; 26+ messages in thread

From: Christopher Browne @ 2005-02-13 01:34 UTC (permalink / raw)
  To: pgsql-performance

Oops! merlin.moncure@rcsonline.com ("Merlin Moncure") was seen spray-painting on a wall:
> Instead of measuring transactions/second, let's put everything in terms
> of transactions/dollar.  This will make it quite easy to determine which
> database is which from the results.  Since postgresql is free and would
> invalidate our test on mathematical terms, we will sub in the $19.99
> price of a T-Shirt (http://www.sourcewear.com/) for the price of the
> database.
>
> TP$		Database
> -------------------------------
> 25          A
> .5          B
> .01         C
> .001        D
> .00001      E

Ah, but that's a completely wrong evaluation.

The fact that PostgreSQL is available without licensing charges does
_not_ make a transactions/dollar ratio break down.

After all, the cost of a computer system to run the transactions is
likely to be comprised of some combination of software licenses and
hardware costs.  Even if the software is free, the hardware isn't.

If you're doing a high end evaluation, you probably have a million
dollars worth of computer hardware.

If you're running PostgreSQL, that may mean you can afford to throw
some extra RAM on the box, but you still need the million dollar
server in order to get hefty TPS counts...
-- 
(reverse (concatenate 'string "moc.liamg" "@" "enworbbc"))
http://cbbrowne.com/info/linuxdistributions.html
"Let's face it  -- ASCII text is  a far richer medium  than most of us
deserve."  -- Scott McNealy



^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-11 20:41 Re: Benchmark Merlin Moncure <merlin.moncure@rcsonline.com>
  2005-02-13 01:34 ` Re: Benchmark Christopher Browne <cbbrowne@acm.org>
@ 2005-02-13 16:34   ` Greg Stark <gsstark@mit.edu>
  2005-02-14 10:46     ` Re: Benchmark Harald Fuchs <hf0722x@protecting.net>
  1 sibling, 1 reply; 26+ messages in thread

From: Greg Stark @ 2005-02-13 16:34 UTC (permalink / raw)
  To: Christopher Browne <cbbrowne@acm.org>; +Cc: pgsql-performance

Christopher Browne <cbbrowne@acm.org> writes:

> After all, the cost of a computer system to run the transactions is
> likely to be comprised of some combination of software licenses and
> hardware costs.  Even if the software is free, the hardware isn't.

And labour costs.

-- 
greg




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-11 20:41 Re: Benchmark Merlin Moncure <merlin.moncure@rcsonline.com>
  2005-02-13 01:34 ` Re: Benchmark Christopher Browne <cbbrowne@acm.org>
  2005-02-13 16:34   ` Re: Benchmark Greg Stark <gsstark@mit.edu>
@ 2005-02-14 10:46     ` Harald Fuchs <hf0722x@protecting.net>
  0 siblings, 0 replies; 26+ messages in thread

From: Harald Fuchs @ 2005-02-14 10:46 UTC (permalink / raw)
  To: pgsql-performance

In article <87mzu85sgh.fsf@stark.xeocode.com>,
Greg Stark <gsstark@mit.edu> writes:

> Christopher Browne <cbbrowne@acm.org> writes:
>> After all, the cost of a computer system to run the transactions is
>> likely to be comprised of some combination of software licenses and
>> hardware costs.  Even if the software is free, the hardware isn't.

> And labour costs.

Except that working with PostgreSQL is fun, not labour :-)




^ permalink  raw  reply  [nested|flat] 26+ messages in thread

* Re: Benchmark
  2005-02-11 20:41 Re: Benchmark Merlin Moncure <merlin.moncure@rcsonline.com>
  2005-02-13 01:34 ` Re: Benchmark Christopher Browne <cbbrowne@acm.org>
@ 2005-02-13 19:24   ` Patrick Meylemans <Patrick.Meylemans@wtcm.be>
  1 sibling, 0 replies; 26+ messages in thread

From: Patrick Meylemans @ 2005-02-13 19:24 UTC (permalink / raw)
  To: Greg Stark <gsstark@mit.edu>; Christopher Browne <cbbrowne@acm.org>; +Cc: pgsql-performance

Dear,

We are using PostgreSQL for 4 Years now, one can say it is a blessing to 
maintain. Our previous database was number one (;-), it was much harder to 
maintain so labor is a pro for PostgreSQL ...

Kind Regards

Patrick Meylemans

IT Manager
WTCM-CRIF
Celestijnenlaan 300C
3001 Helerlee


At 11:34 13/02/2005 -0500, Greg Stark wrote:
>Christopher Browne <cbbrowne@acm.org> writes:
>
> > After all, the cost of a computer system to run the transactions is
> > likely to be comprised of some combination of software licenses and
> > hardware costs.  Even if the software is free, the hardware isn't.
>
>And labour costs.
>
>--
>greg
>
>
>---------------------------(end of broadcast)---------------------------
>TIP 6: Have you searched our list archives?
>
>                http://archives.postgresql.org

^ permalink  raw  reply  [nested|flat] 26+ messages in thread


end of thread, other threads:[~2005-02-14 10:46 UTC | newest]

Thread overview: 26+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-08-15 06:33 Benchmark mixo <mixo@coza.net.za>
2003-08-15 09:32 ` Tomka Gergely <tomka@zeus.gau.hu>
2003-08-15 13:12 ` Richard Huxton <dev@archonet.com>
2003-08-15 18:24   ` Jeff <threshar@torgo.978.org>
2003-08-15 16:21 ` Josh Berkus <josh@agliodbs.com>
2003-08-17 03:48   ` David Emery <dave@skiddlydee.com>
2003-08-15 18:47 ` Balazs Wellisch <balazs@neusolutions.com>
2005-02-10 05:49 Benchmark Jaime Casanova <systemguards@yahoo.com>
2005-02-10 13:21 ` Jeff <threshar@torgo.978.org>
2005-02-11 05:22   ` Mitch Pirtle <mitch.pirtle@gmail.com>
2005-02-11 06:38     ` Tom Lane <tgl@sss.pgh.pa.us>
2005-02-11 07:04       ` Mitch Pirtle <mitch.pirtle@gmail.com>
2005-02-11 13:20         ` Jeff <threshar@torgo.978.org>
2005-02-11 15:04           ` Greg Stark <gsstark@mit.edu>
2005-02-11 18:32             ` PFC <lists@boutiquenumerique.com>
2005-02-11 07:22       ` Jaime Casanova <systemguards@gmail.com>
2005-02-11 13:08         ` Bruno Wolff III <bruno@wolff.to>
2005-02-11 13:16           ` Richard Huxton <dev@archonet.com>
2005-02-11 18:09     ` Mike Benoit <ipso@snappymail.ca>
2005-02-11 18:41       ` Tom Lane <tgl@sss.pgh.pa.us>
2005-02-13 09:21         ` Ron Mayer <rm_pg@cheapcomplexdevices.com>
2005-02-11 20:41 Re: Benchmark Merlin Moncure <merlin.moncure@rcsonline.com>
2005-02-13 01:34 ` Christopher Browne <cbbrowne@acm.org>
2005-02-13 16:34   ` Greg Stark <gsstark@mit.edu>
2005-02-14 10:46     ` Harald Fuchs <hf0722x@protecting.net>
2005-02-13 19:24   ` Patrick Meylemans <Patrick.Meylemans@wtcm.be>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox