From: Stephen Frost <sfrost@snowman.net>
To: Brandon Black <blblack@gmail.com>
Cc: Greg Stark <gsstark@mit.edu>
Cc: pgsql-performance@postgresql.org
Subject: Re: Performance considerations for very heavy INSERT traffic
Date: Tue, 13 Sep 2005 10:10:31 -0400
Message-ID: <20050913141031.GJ6026@ns.snowman.net> (raw)
In-Reply-To: <84621a605091220442775249b@mail.gmail.com>
References: <84621a6050912140464c380c3@mail.gmail.com>
<87slw91x8a.fsf@stark.xeocode.com>
<84621a605091220442775249b@mail.gmail.com>
* Brandon Black (blblack@gmail.com) wrote:
> Ideally I'd like to commit the data seperately, as the data could contain
> errors which abort the transaction, but it may come down to batching it and
> coding things such that I can catch and discard the offending row and retry
> the transaction if it fails (which should be fairly rare I would hope). I
Don't really know if it'd be better, or worse, or what, but another
thought to throw out there is to perhaps use savepoints instead of full
transactions? Not sure if that's more expensive or cheaper than doing
full commits but it might be something to consider.
> When I finally get all of this sorted out and working reasonably optimally,
> I'll be sure to come back and report what techniques/settings did and didn't
> work for this workload.
That'd be great, many thanks,
Stephen
Attachments:
signature.asc (application/pgp-signature, 188B) download
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: sfrost@snowman.net, blblack@gmail.com, gsstark@mit.edu
Subject: Re: Performance considerations for very heavy INSERT traffic
In-Reply-To: <20050913141031.GJ6026@ns.snowman.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox