From: Merlin Moncure <mmoncure@gmail.com>
To: Luke Lonergan <llonergan@greenplum.com>
Cc: Krishna Kumar <kumar.ramanathan@gmail.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: Benchmarking PGSQL?
Date: Thu, 15 Feb 2007 08:39:10 -0500
Message-ID: <b42b73150702150539p98ffd60m1127a2aeb158085c@mail.gmail.com> (raw)
In-Reply-To: <C1F893AA.27270%llonergan@greenplum.com>
References: <b42b73150702140820k7fa0afabn43ec61c3d1d881b7@mail.gmail.com>
<C1F893AA.27270%llonergan@greenplum.com>
On 2/14/07, Luke Lonergan <llonergan@greenplum.com> wrote:
> Hi Merlin,
>
> On 2/14/07 8:20 AM, "Merlin Moncure" <mmoncure@gmail.com> wrote:
>
> > I am curious what is your take on the maximum insert performance, in
> > mb/sec of large bytea columns (toasted), and how much if any greenplum
> > was able to advance this over the baseline. I am asking on behalf of
> > another interested party. Interested in numbers broken down per core
> > on 8 core quad system and also aggreate.
>
> Our approach is to attach a segment to each core, so we scale INSERT
> linearly on number of cores. So the per core limit we live with is the
> 10-20MB/s observed here. We'd like to improve that so that we get better
> performance with smaller machines.
>
> We have demonstrated insert performance of 670 MB/s, 2.4TB/hour for
> non-toasted columns using 3 load machines against 120 cores. This rate was
> load machine limited.
>
> WRT toasted bytea columns we haven't done any real benchmarking of those.
> Do you have a canned benchmark we can run?
Interested in how fast you can insert binary objects (images, files,
etc). into the database as a file storage system. Ultimately the
insertions would all be done via libpq ExecPrepared/Params. A simple
benchmark such as insert a 1mb object via pg_bench over 20 or so
connections would be fine. Mostly interested in raw throughput per
core and especially interested if you can beat stock pg on the same
hardware.
merlin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: mmoncure@gmail.com, llonergan@greenplum.com, kumar.ramanathan@gmail.com
Subject: Re: Benchmarking PGSQL?
In-Reply-To: <b42b73150702150539p98ffd60m1127a2aeb158085c@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox