pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Dimitri <dimitrik.fr@gmail.com>
To: Jonah H. Harris <jonah.harris@gmail.com>
Cc: Jim C. Nasby <decibel@decibel.org>
Cc: Heikki Linnakangas <heikki@enterprisedb.com>
Cc: PostgreSQL Performance <pgsql-performance@postgresql.org>
Subject: Re: Filesystem Direct I/O and WAL sync option
Date: Tue, 10 Jul 2007 14:53:18 +0200
Message-ID: <5482c80a0707100553y36fed046v2dc1bf5050d42eec@mail.gmail.com> (raw)
In-Reply-To: <36e682920707091346w49824ac6x65c8adddbaa0ef7@mail.gmail.com>
References: <5482c80a0707030754o740c82b6s4598dc668720d014@mail.gmail.com>
	<468A65F5.8020800@enterprisedb.com>
	<20070709203220.GO39272@nasby.net>
	<36e682920707091346w49824ac6x65c8adddbaa0ef7@mail.gmail.com>

Yes, I tried all WAL sync methods, but there was no difference...
However, there was a huge difference when I run the same tests under
Solaris10 - 'fdatasync' option gave the best performance level. On the
same time direct I/O did not make difference on Solaris 10 :)

So the main rule - there is no universal rule :)
just adapt system options according your workload...

Direct I/O will generally speed-up write operation due avoiding buffer
flashing overhead as well concurrent writing (breaking POSIX
limitation of single writer per given file on the same time). But on
the same time it may slow-down your read operations, and you may need
64bit PG version to use big cache to still keep same performance level
on SELECT queries. And again, there are other file systems like QFS
(for ex.) which may give you the best of both worlds: direct write and
buffered read on the same time! etc. etc. etc. :)

Rgds,
-Dimitri

On 7/9/07, Jonah H. Harris <jonah.harris@gmail.com> wrote:
> On 7/9/07, Jim C. Nasby <decibel@decibel.org> wrote:
> > BTW, it might be worth trying the different wal_sync_methods. IIRC,
> > Jonah's seen some good results from open_datasync.
>
> On Linux, using ext3, reiser, or jfs, I've seen open_sync perform
> quite better than fsync/fdatasync in most of my tests.  But, I haven't
> done significant testing with direct I/O lately.
>
> --
> Jonah H. Harris, Software Architect | phone: 732.331.1324
> EnterpriseDB Corporation            | fax: 732.331.1301
> 33 Wood Ave S, 3rd Floor            | jharris@enterprisedb.com
> Iselin, New Jersey 08830            | http://www.enterprisedb.com/
>



view thread (10+ messages)

Message-ID: <5482c80a0707100553y36fed046v2dc1bf5050d42eec@mail.gmail.com>
Permalink:  ../5482c80a0707100553y36fed046v2dc1bf5050d42eec@mail.gmail.com/
Also on:    postgresql.org/message-id/5482c80a0707100553y36fed046v2dc1bf5050d42eec@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: dimitrik.fr@gmail.com, jonah.harris@gmail.com, decibel@decibel.org, heikki@enterprisedb.com
  Subject: Re: Filesystem Direct I/O and WAL sync option
  In-Reply-To: <5482c80a0707100553y36fed046v2dc1bf5050d42eec@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox