User-Agent: Microsoft-Entourage/11.3.3.061214
Date: Wed, 14 Feb 2007 10:23:38 -0800
Subject: Re: Benchmarking PGSQL?
From: "Luke Lonergan" <llonergan@greenplum.com>
To: "Merlin Moncure" <mmoncure@gmail.com>
cc: "Krishna Kumar" <kumar.ramanathan@gmail.com>,
	pgsql-performance@postgresql.org
Message-ID: <C1F893AA.27270%llonergan@greenplum.com>
Thread-Topic: [PERFORM] Benchmarking PGSQL?
Thread-Index: AcdQZT7dfZkL1LxYEdu7eQAWy4o9DA==
In-Reply-To: <b42b73150702140820k7fa0afabn43ec61c3d1d881b7@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain;
 charset=us-ascii
Content-Transfer-Encoding: 7bit

Hi Merlin,

On 2/14/07 8:20 AM, "Merlin Moncure" <mmoncure@gmail.com> wrote:

> I am curious what is your take on the maximum insert performance, in
> mb/sec of large bytea columns (toasted), and how much if any greenplum
> was able to advance this over the baseline.  I am asking on behalf of
> another interested party.  Interested in numbers broken down per core
> on 8 core quad system and also aggreate.

Our approach is to attach a segment to each core, so we scale INSERT
linearly on number of cores.  So the per core limit we live with is the
10-20MB/s observed here.  We'd like to improve that so that we get better
performance with smaller machines.

We have demonstrated insert performance of 670 MB/s, 2.4TB/hour for
non-toasted columns using 3 load machines against 120 cores.  This rate was
load machine limited.

WRT toasted bytea columns we haven't done any real benchmarking of those.
Do you have a canned benchmark we can run?

- Luke