pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Kevin Brown <kevin@sysexperts.com>
To: pgsql-performance@postgresql.org
Cc: Josh Berkus <josh@agliodbs.com>
Subject: Re: ext3 filesystem / linux 7.3
Date: Tue, 8 Apr 2003 16:22:47 -0700
Message-ID: <20030408232247.GH1847@filer> (raw)
In-Reply-To: <200304030943.06406.josh@agliodbs.com>
References: <231C6A82-65C3-11D7-8D88-0003939CC61E@trilug.org>
	<200304030852.34194.josh@agliodbs.com>
	<0b7a01c2fa04$2d299bf0$0b02a8c0@pointhere.net>
	<200304030943.06406.josh@agliodbs.com>

Josh Berkus wrote:
> Jeffery,
> 
> > Can't we generate data?  Random data stored in random formats at random
> > sizes would stress the file system wouldn't it?
> 
> In my experience, randomly generated data tends to resemble real data very 
> little in distribution patterns and data types.  This is one of the 
> limitations of PGBench.

Okay, from this it sounds like what we need is information on the data
types typically used for real world applications and information on
the the distribution patterns for each type (the latter could get
quite complex and varied, I'm sure, but since we're after something
that's typical, we only need a few examples).

So perhaps the first step in this is to write something that will show
what the distribution pattern for data in a table is?  With that
information, we *could* randomly generate data that would conform to
the statistical patterns seen in the real world.

In fact, even though the databases you have access to are all
proprietary, I'm pretty sure their owners would agree to let you run a
program that would gather statistical distribution about it.  Then (as
long as they agree) you could copy the schema itself, recreate it on
the test system, and randomly generate the data.



-- 
Kevin Brown					      kevin@sysexperts.com




view thread (42+ messages)  latest in thread

Message-ID: <20030408232247.GH1847@filer>
Permalink:  ../20030408232247.GH1847@filer/
Also on:    postgresql.org/message-id/20030408232247.GH1847@filer

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-performance@postgresql.org
  Cc: kevin@sysexperts.com, josh@agliodbs.com
  Subject: Re: ext3 filesystem / linux 7.3
  In-Reply-To: <20030408232247.GH1847@filer>
  References: <231C6A82-65C3-11D7-8D88-0003939CC61E@trilug.org> <200304030852.34194.josh@agliodbs.com> <0b7a01c2fa04$2d299bf0$0b02a8c0@pointhere.net> <200304030943.06406.josh@agliodbs.com> <20030408232247.GH1847@filer>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox