X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by postgresql.org (Postfix) with ESMTP id 47D0811F6BB5 for ; Fri, 31 Mar 2006 14:37:37 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 88014-07 for ; Fri, 31 Mar 2006 14:37:35 -0400 (AST) X-Greylist: from auto-whitelisted by SQLgrey- Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by postgresql.org (Postfix) with ESMTP id A2E6811F6B5F for ; Fri, 31 Mar 2006 14:37:34 -0400 (AST) Received: by noel.decibel.org (Postfix, from userid 1001) id 06C5456427; Fri, 31 Mar 2006 12:37:34 -0600 (CST) Received: (hashcash-sendmail, from uid 1001); Fri, 31 Mar 2006 12:37:32 -0600 Date: Fri, 31 Mar 2006 12:37:32 -0600 From: "Jim C. Nasby" To: Rafael Martinez Cc: Scott Marlowe , pgsql-admin@postgresql.org Subject: Re: Bloated pg_shdepend_depender_index Message-ID: <20060331183732.GV49405@pervasive.com> References: <1143547721.24060.112.camel@bbking.uio.no> <20060328180937.GS75181@pervasive.com> <1143575509.18329.13.camel@linux.site> <1143580500.3625.92.camel@state.g2switchworks.com> <1143587159.18329.56.camel@linux.site> <20060328231707.GA561@pervasive.com> <1143652750.18329.89.camel@linux.site> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1143652750.18329.89.camel@linux.site> X-Operating-System: FreeBSD 6.0-RELEASE-p4 amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 X-Hashcash: 1:20:060331:r.m.guerrero@usit.uio.no::nZuA9flg6jdvcL3+:0000000000000 0000000000000000000000006Tdu X-Hashcash: 1:20:060331:smarlowe@g2switchworks.com::GyQ2TyWKRctbVB5a:00000000000 0000000000000000000000005hYj X-Hashcash: 1:20:060331:pgsql-admin@postgresql.org::RrpLFy0ByFrS9F9X:00000000000 00000000000000000000000030H5 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, score=0.108 required=5 tests=[AWL=0.108] X-Spam-Score: 0.108 X-Spam-Level: X-Archive-Number: 200603/404 X-Sequence-Number: 21161 On Wed, Mar 29, 2006 at 07:19:10PM +0200, Rafael Martinez wrote: > On Tue, 2006-03-28 at 17:17 -0600, Jim C. Nasby wrote: > > On Wed, Mar 29, 2006 at 01:05:59AM +0200, Rafael Martinez wrote: > > > I work with postgresql every day and I am very happy with it, but this > > > does not mean I can not see the issues that could be improve to have a > > > even better open source DBMS. And I think in my humble opinion that > > > bloated indexes + better upgrade procedures between major releases are > > > two things that should get improved in the future. > > > > FWIW, I don't know of any upgrade procedures for databases that can > > quickly do an in-place upgrade when underlying file structures change, > > because ultimately you need to read and write the entire database > > on-disk. > > I know there is not an easy solution to the dump/restore procedure, and > maybe even it is not possible (I am not a postgres developer and don't > know the postgres internals and what it is necessary to do between major > releases) Does the file structures change always between every major > release? It depends. Sometimes the changes aren't as much in the files as they are in the system catalogs. Ideally, what we'd have is the ability to deal with data that was stored in the last versions format. Any time an old row gets changed, it gets re-written in the new format (probably on a different page). While this would present some challenges, it would make for very, very fast upgrades. Unfortunately, it would also greatly increase code complexity and maintenance costs, so it's rather unlikely it will ever happen. Maybe if someone forks over a very large sum of money, but even then it's unlikely... An actual upgrade script is more likely, but even there you still need to have a backup (actually, that's really pretty true of both cases). This idea does have some traction though, and if someone produced a working utility there's a decent chance it would be accepted. -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461