X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by postgresql.org (Postfix) with ESMTP id BA76A9DC9B2 for ; Tue, 21 Mar 2006 07:35:06 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 49991-01 for ; Tue, 21 Mar 2006 07:35:08 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey- Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by postgresql.org (Postfix) with ESMTP id 589959DC8DE for ; Tue, 21 Mar 2006 07:35:04 -0400 (AST) Received: by noel.decibel.org (Postfix, from userid 1001) id 28A4B56435; Tue, 21 Mar 2006 05:35:07 -0600 (CST) Received: (hashcash-sendmail, from uid 1001); Tue, 21 Mar 2006 05:35:06 -0600 Date: Tue, 21 Mar 2006 05:35:06 -0600 From: "Jim C. Nasby" To: Orion Henry Cc: pgsql-performance@postgresql.org Subject: Re: Auto performance tuning? Message-ID: <20060321113506.GG15742@pervasive.com> References: <441EFEA2.70207@orangekids.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <441EFEA2.70207@orangekids.org> X-Operating-System: FreeBSD 6.0-RELEASE-p4 amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 X-Hashcash: 1:20:060321:lab@orangekids.org::aZkbwajK/Og43GB+:0000000000000000000 0000000000000000000000003/FA X-Hashcash: 1:20:060321:pgsql-performance@postgresql.org::sgu4hS+9ZmQPKEDX:00000 0000000000000000000000003IHR X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, score=0.108 required=5 tests=[AWL=0.108] X-Spam-Score: 0.108 X-Spam-Level: X-Archive-Number: 200603/381 X-Sequence-Number: 17818 On Mon, Mar 20, 2006 at 11:12:34AM -0800, Orion Henry wrote: > > I have to say I've been really impressed with the quality and diversity > of tools here to increase performance for PostgreSQL. But I keep seeing > a lot of the same basic things repeated again and again. Has anyone > looked into a "smart" or auto-adjusting resource manager for postgres? > > Consider for instance you set it to aggressively use system resources, > then it would do things like notice that it needs more work mem after > profiling a few thousand queries and adds it for you, or that a specific > index or table should be moved to a different spindle and does it in the > background, or that query plans keep screwing up on a particular table > so it knows to up the amount of stastics it keeps on that table. > > Is this a crazy idea or something someone's already working on? Feel free to submit a patch. :) Seriously, the issue here is that everyone who donates code for PostgreSQL already knows how to tune it, so they're unlikely to come up with a tool to do it for them (which is much harder than you might think). There is the configurator project on pgFoundry, which is a start in the right direction. Perhaps at some point a commercial entity might come out with some kind of automatic tuning tool as well. But I doubt you'll see anything come out of the core developers. Also, note that you could probably write such a tool without embedding it into the backend, so don't let that scare you off. :) -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461