pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Chris Browne <cbbrowne@acm.org>
To: pgsql-performance@postgresql.org
Subject: Re: Recommended File System Configuration
Date: Mon, 03 May 2004 12:38:33 -0400
Message-ID: <60zn8pcvp2.fsf@dev6.int.libertyrms.info> (raw)
References: <4094AD20.6090707@jamesthornton.com>

james@jamesthornton.com (James Thornton) writes:
> Back in 2001, there was a lengthy thread on the PG Hackers list about
> PG and journaling file systems
> (http://archives.postgresql.org/pgsql-hackers/2001-05/msg00017.php),
> but there was no decisive conclusion regarding what FS to use. At the
> time the fly in the XFS ointment was that deletes were slow, but this
> was improved with XFS 1.1.
>
> I think a journaling a FS is needed for PG data since large DBs could
> take hours to recover on a non-journaling FS, but what about WAL files?

If the WAL files are on a small filesystem, it presumably won't take
hours for that filesystem to recover at fsck time.

The results have not been totally conclusive...

 - Several have found JFS to be a bit faster than anything else on
   Linux, but some data loss problems have been experienced;

 - ext2 has the significant demerit that with big filesystems, fsck
   will "take forever" to run;

 - ext3 appears to be the slowest option out there, and there are some
   stories of filesystem corruption;

 - ReiserFS was designed to be real fast with tiny files, which is not
   the ideal "use case" for PostgreSQL; the designers there are
   definitely the most aggressive at pushing out "bleeding edge" code,
   which isn't likely the ideal;

 - XFS is neither fastest nor slowest, but there has been a lack of
   reports of "spontaneous data loss" under heavy load, which is a
   good thing.  It's not part of "official 2.4" kernels, requiring
   backports, but once 2.6 gets more widely deployed, this shouldn't
   be a demerit anymore...

I think that provides a reasonable overview of what has been seen...
-- 
output = reverse("gro.gultn" "@" "enworbbc")
http://cbbrowne.com/info/oses.html
Donny: Are these the Nazis, Walter?
Walter: No, Donny, these men are nihilists. There's nothing to be
afraid of.  -- The Big Lebowski



view thread (3+ messages)  latest in thread

Message-ID: <60zn8pcvp2.fsf@dev6.int.libertyrms.info>
Permalink:  ../60zn8pcvp2.fsf@dev6.int.libertyrms.info/
Also on:    postgresql.org/message-id/60zn8pcvp2.fsf@dev6.int.libertyrms.info

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: cbbrowne@acm.org
  Subject: Re: Recommended File System Configuration
  In-Reply-To: <60zn8pcvp2.fsf@dev6.int.libertyrms.info>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox