pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Bruce Momjian <bruce@momjian.us>
To: Ron Mayer <rm_pg@cheapcomplexdevices.com>
Cc: pgsql-general@postgresql.org
Subject: Re: Priorities for users or queries?
Date: Tue, 27 Mar 2007 11:36:31 -0400 (EDT)
Message-ID: <200703271536.l2RFaVK07108@momjian.us> (raw)
In-Reply-To: <45DB81EA.9080401@cheapcomplexdevices.com>


Added to TODO:

* Allow configuration of backend priorities via the operating system

  Though backend priorities make priority inversion during lock
  waits possible, research shows that this is not a huge problem.
  http://archives.postgresql.org/pgsql-general/2007-02/msg00493.php


---------------------------------------------------------------------------

Ron Mayer wrote:
> Bruce Momjian wrote:
> > Hard to argue with that.
> 
> Is it a strong enough argument to add a TODO?
> 
> 
> I'm thinking some sort of TODO might be called for.
> 
> Perhaps two TODOs?
>   * Use the OS's priority features to prioritize
>     backends (and document that it might work
>     better with OS's that support priority inheritance).
>   * Investigate if postgresql could develop an
>     additional priority mechanism instead of using
>     the OS's.
> 
> > Ron Mayer wrote:
> >> Magnus Hagander wrote: ...
> >>> quite likely to suffer from priority inversion
> >> ... CMU paper... tested PostgreSQL (and DB2) on TPC-C 
> >> and TPC-W ...found that...I/O scheduling through 
> >> CPU priorities is a big win for postgresql.
> >>
> >> http://www.cs.cmu.edu/~bianca/icde04.pdf
> 
> Setting priorities seems a rather common request,
> supposedly coming up every couple months [5].
> 
> The paper referenced [1] suggests that even with
> naive schedulers, use of CPU priorities is very
> effective for CPU and I/O intensive PostgreSQL
> workloads.
> 
> If someone eventually finds a workload that does suffer
> worse performance due to priority inversion,
> (a) they could switch to an OS and scheduler
> that supports priority inheritance;
> (b) it'd be an interesting case for a paper
> rebutting the CMU one; and
> (c) they don't have to use priorities.
> 
> If a user does find he wants priority inheritance it
> seems Linux[1], BSD[2], some flavors of Windows[3],
> and Solaris[4] all seem to be options; even though
> I've only seen PostgreSQL specifically tested for
> priority inversion problems with Linux (which did
> not find problems but found additional benefit of
> using priority inheritance).
> 
> 
> 
> 
> [1] Linux with Priority inheritance showing benefits for
>     PostgreSQL
>     http://www.cs.cmu.edu/~bianca/icde04.pdf
> [2] BSD priority inheritance work mentioned:
>     http://www.freebsd.org/news/status/report-july-2004-dec-2004.html
> [3] Windows priority inheritance stuff:
>     http://msdn2.microsoft.com/en-us/library/aa915356.aspx
> [4] Solaris priority inheritance stuff
>     http://safari5.bvdep.com/0131482092/ch17lev1sec7
>     http://www.itworld.com/AppDev/1170/swol-1218-insidesolaris/
> [5] Tom suggests that priorities are a often requested feature.
>     http://svr5.postgresql.org/pgsql-performance/2006-05/msg00463.php
> 
> ---------------------------(end of broadcast)---------------------------
> TIP 3: Have you checked our extensive FAQ?
> 
>                http://www.postgresql.org/docs/faq

-- 
  Bruce Momjian  <bruce@momjian.us>          http://momjian.us
  EnterpriseDB                               http://www.enterprisedb.com

  + If your life is a hard drive, Christ can be your backup. +



view thread (30+ messages)  latest in thread

Message-ID: <200703271536.l2RFaVK07108@momjian.us>
Permalink:  ../200703271536.l2RFaVK07108@momjian.us/
Also on:    postgresql.org/message-id/200703271536.l2RFaVK07108@momjian.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: bruce@momjian.us, rm_pg@cheapcomplexdevices.com, pgsql-general@postgresql.org
  Subject: Re: Priorities for users or queries?
  In-Reply-To: <200703271536.l2RFaVK07108@momjian.us>
  References: <45DB81EA.9080401@cheapcomplexdevices.com> <200703271536.l2RFaVK07108@momjian.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox