pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Greg Stark <gsstark@MIT.EDU>
Cc: pgsql-hackers@postgresql.org
Subject: Re: [PATCHES] ARC Memory Usage analysis
Date: Mon, 25 Oct 2004 17:53:25 -0400
Message-ID: <790.1098741205@sss.pgh.pa.us> (raw)
In-Reply-To: <87hdoiv62b.fsf@stark.xeocode.com>
References: <1098471059.20926.49.camel@localhost.localdomain>
	<41796115.2020501@Yahoo.com>
	<20041022200955.GC4382@it.is.rice.edu>
	<417D1D01.3090401@Yahoo.com>
	<20651.1098720192@sss.pgh.pa.us>
	<87mzyavhxc.fsf@stark.xeocode.com>
	<87hdoiv62b.fsf@stark.xeocode.com>

Greg Stark <gsstark@MIT.EDU> writes:
> So I would suggest using something like 100us as the threshold for
> determining whether a buffer fetch came from cache.

I see no reason to hardwire such a number.  On any hardware, the
distribution is going to be double-humped, and it will be pretty easy to
determine a cutoff after minimal accumulation of data.  The real question
is whether we can afford a pair of gettimeofday() calls per read().
This isn't a big issue if the read actually results in I/O, but if it
doesn't, the percentage overhead could be significant.

If we assume that the effective_cache_size value isn't changing very
fast, maybe it would be good enough to instrument only every N'th read
(I'm imagining N on the order of 100) for this purpose.  Or maybe we
need only instrument reads that are of blocks that are close to where
the ARC algorithm thinks the cache edge is.

One small problem is that the time measurement gives you only a lower
bound on the time the read() actually took.  In a heavily loaded system
you might not get the CPU back for long enough to fool you about whether
the block came from cache or not.

Another issue is what we do with the effective_cache_size value once we
have a number we trust.  We can't readily change the size of the ARC
lists on the fly.

			regards, tom lane



view thread (32+ messages)  latest in thread

Message-ID: <790.1098741205@sss.pgh.pa.us>
Permalink:  ../790.1098741205@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/790.1098741205@sss.pgh.pa.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: tgl@sss.pgh.pa.us, gsstark@MIT.EDU, pgsql-hackers@postgresql.org
  Subject: Re: [PATCHES] ARC Memory Usage analysis
  In-Reply-To: <790.1098741205@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox