pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Craig James <craig_james@emolecules.com>
To: pgsql-performance@postgresql.org
Subject: Re: Block at a time ...
Date: Wed, 17 Mar 2010 09:41:44 -0700
Message-ID: <4BA10648.6010609@emolecules.com> (raw)
In-Reply-To: <407d949e1003170252y72d223c3kcc18266140a60997@mail.gmail.com>
References: <ca24673e1003161658g6a0fa30dg2c158db395ac08@mail.gmail.com>
	<20100317001405.GL3037@alvh.no-ip.org>
	<op.u9pa7vzleorkce@localhost>
	<407d949e1003170252y72d223c3kcc18266140a60997@mail.gmail.com>

On 3/17/10 2:52 AM, Greg Stark wrote:
> On Wed, Mar 17, 2010 at 7:32 AM, Pierre C<lists@peufeu.com>  wrote:
>>> I was thinking in something like that, except that the factor I'd use
>>> would be something like 50% or 100% of current size, capped at (say) 1 GB.
>
> This turns out to be a bad idea. One of the first thing Oracle DBAs
> are told to do is change this default setting to allocate some
> reasonably large fixed size rather than scaling upwards.
>
> This might be mostly due to Oracle's extent-based space management but
> I'm not so sure. Recall that the filesystem is probably doing some
> rounding itself. If you allocate 120kB it's probably allocating 128kB
> itself anyways. Having two layers rounding up will result in odd
> behaviour.
>
> In any case I was planning on doing this a while back. Then I ran some
> experiments and couldn't actually demonstrate any problem. ext2 seems
> to do a perfectly reasonable job of avoiding this problem. All the
> files were mostly large contiguous blocks after running some tests --
> IIRC running pgbench.

This is one of the more-or-less solved problems in Unix/Linux.  Ext* file systems have a "reserve" usually of 10% of the disk space that nobody except root can use.  It's not for root, it's because with 10% of the disk free, you can almost always do a decent job of allocating contiguous blocks and get good performance.  Unless Postgres has some weird problem that Linux has never seen before (and that wouldn't be unprecedented...), there's probably no need to fool with file-allocation strategies.

Craig



view thread (14+ messages)  latest in thread

Message-ID: <4BA10648.6010609@emolecules.com>
Permalink:  ../4BA10648.6010609@emolecules.com/
Also on:    postgresql.org/message-id/4BA10648.6010609@emolecules.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: craig_james@emolecules.com
  Subject: Re: Block at a time ...
  In-Reply-To: <4BA10648.6010609@emolecules.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox