Received: from localhost (maia-2.hub.org [200.46.204.187]) by postgresql.org (Postfix) with ESMTP id BE6589FB27B; Thu, 11 Jan 2007 17:16:49 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.187]) (amavisd-new, port 10024) with ESMTP id 77590-03; Thu, 11 Jan 2007 17:16:12 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey-1.7.4 X-Greylist: from auto-whitelisted by SQLgrey-1.7.4 Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by postgresql.org (Postfix) with ESMTP id EC7FB9FB27A; Thu, 11 Jan 2007 17:16:15 -0400 (AST) Received: by noel.decibel.org (Postfix, from userid 1001) id 83BAB56423; Thu, 11 Jan 2007 15:16:14 -0600 (CST) Received: (hashcash-sendmail, from uid 1001); Thu, 11 Jan 2007 15:16:09 -0600 Date: Thu, 11 Jan 2007 15:16:09 -0600 From: "Jim C. Nasby" To: Tom Lane , Kim , pgsql-performance@postgresql.org, pgsql-hackers@postgresql.org Subject: Re: [HACKERS] unusual performance for vac following 8.2 upgrade Message-ID: <20070111211609.GT36267@nasby.net> References: <45A671CD.1050706@myemma.com> <27939.1168539652@sss.pgh.pa.us> <45A68C74.4080405@myemma.com> <28949.1168544710@sss.pgh.pa.us> <20070111194928.GC10464@alvh.no-ip.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070111194928.GC10464@alvh.no-ip.org> X-Operating-System: FreeBSD 6.1-RELEASE-p10 amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.13 (2006-08-11) X-Hashcash: 1:20:070111:tgl@sss.pgh.pa.us::8RfMYe1eEAmBaD9L:00000000000000000000 0000000000000000000000004KV1 X-Hashcash: 1:20:070111:kim@myemma.com::pjSZDJqF3sbobeJH:0006ZuD X-Hashcash: 1:20:070111:pgsql-performance@postgresql.org::p84J3rEH33bD4eqP:00000 0000000000000000000000004WSr X-Hashcash: 1:20:070111:pgsql-hackers@postgresql.org::ciakNSs75selmjnq:000000000 000000000000000000000000Cbs8 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200701/188 X-Sequence-Number: 22789 On Thu, Jan 11, 2007 at 04:49:28PM -0300, Alvaro Herrera wrote: > Tom Lane wrote: > > > What I think we need to do about this is > > > > (1) fix pgstat_vacuum_tabstats to have non-O(N^2) behavior; I'm thinking > > of using a hash table for the OIDs instead of a linear list. Should be > > a pretty small change; I'll work on it today. > > > > (2) Reconsider whether last-vacuum-time should be sent to the collector > > unconditionally. > > (2) seems a perfectly reasonably answer, but ISTM (1) would be good to > have anyway (at least in HEAD). Actually, I'd rather see the impact #1 has before adding #2... If #1 means we're good for even someone with 10M relations, I don't see much point in #2. BTW, we're now starting to see more users with a large number of relations, thanks to partitioning. It would probably be wise to expand test coverage for that case, especially when it comes to performance. -- Jim Nasby jim@nasby.net EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)