X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id EE01A564C6 for ; Tue, 22 Mar 2005 17:02:03 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 97372-08 for ; Tue, 22 Mar 2005 17:01:57 +0000 (GMT) Received: from davinci.ethosmedia.com (server227.ethosmedia.com [209.128.84.227]) by svr1.postgresql.org (Postfix) with ESMTP id 4EDD3569D6 for ; Tue, 22 Mar 2005 17:01:56 +0000 (GMT) X-EthosMedia-Virus-Scanned: no infections found Received: from [63.195.55.98] (account josh@agliodbs.com HELO spooky) by davinci.ethosmedia.com (CommuniGate Pro SMTP 4.1.8) with ESMTP id 7155173; Tue, 22 Mar 2005 09:03:46 -0800 From: Josh Berkus Organization: Aglio Database Solutions To: Hannu Krosing Subject: Re: What needs to be done for real Partitioning? Date: Tue, 22 Mar 2005 09:01:23 -0800 User-Agent: KMail/1.6.2 Cc: pgsql-performance@postgresql.org References: <200503191202.38089.josh@agliodbs.com> <1111422773.4675.33.camel@fuji.krosing.net> In-Reply-To: <1111422773.4675.33.camel@fuji.krosing.net> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <200503220901.23481.josh@agliodbs.com> X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.011 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200503/455 X-Sequence-Number: 11160 Hannu, > If you don't get it, contact me as there is a small possibility that I > know a company interested enough to fund (some) of it :) Enough people have been interested in this that if we get our acts together, we may do it as multi-funded. Easier on our budget ... > As these are already discussed in this thread, I'll try to outline a > method of providing a global index (unique or not) in a way that will > still make it possible to quickly remove (and not-quite-so-quickly add) > a partition. > To repeat - the global index over partitioned table should have te same > structure as our current b-tree index, only with added map of 128k index > partitions to 1G subfiles of (possibly different) tables. This map will > be quite small - for 1Tb of data it will be only 1k entries - this will > fit in cache on all modern processors and thus should add only tiny > slowdown from current direct tid.page/128k method I think this is a cool idea. It would need to be linked to clustering, so that each partition can be an iteration of the clustered index instead of a specifc # of bytes. But it would give us the "fully automated partitioning" which is one fork of the two we want. Plus I'm keen on any idea that presents an alternative to aping Oracle. How difficult would your proposal be to code? -- Josh Berkus Aglio Database Solutions San Francisco