pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Laurent Laborde <kerdezixe@gmail.com>
To: PostgreSQL Performance <pgsql-performance@postgresql.org>
Subject: limiting performance impact of wal archiving.
Date: Tue, 10 Nov 2009 12:55:42 +0100
Message-ID: <8a1bfe660911100355l34a557ffj8244079c1fb689b5@mail.gmail.com> (raw)

Hi !
We recently had a problem with wal archiving badly impacting the
performance of our postgresql master.
And i discovered "cstream", that can limite the bandwidth of pipe stream.

Here is our new archive command, FYI, that limit the IO bandwidth to 500KB/s  :
archive_command = '/bin/cat %p | cstream -i "" -o "" -t -500k | nice
gzip -9 -c | /usr/bin/ncftpput etc...'


PS : While writing that mail, i just found that i could replace :
cat %p | cstream -i "" ...
with
cstream -i %p ...
*grins*


-- 
ker2x
Sysadmin & DBA @ http://Www.over-blog.com/



view thread (23+ messages)  latest in thread

Message-ID: <8a1bfe660911100355l34a557ffj8244079c1fb689b5@mail.gmail.com>
Permalink:  ../8a1bfe660911100355l34a557ffj8244079c1fb689b5@mail.gmail.com/
Also on:    postgresql.org/message-id/8a1bfe660911100355l34a557ffj8244079c1fb689b5@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: kerdezixe@gmail.com
  Subject: Re: limiting performance impact of wal archiving.
  In-Reply-To: <8a1bfe660911100355l34a557ffj8244079c1fb689b5@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox