Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Xy6RO-0003wm-33 for pgsql-hackers@arkaria.postgresql.org; Mon, 08 Dec 2014 22:06:02 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1Xy6RN-0001IF-K9 for pgsql-hackers@arkaria.postgresql.org; Mon, 08 Dec 2014 22:06:01 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1Xy6RM-0001I9-Nx for pgsql-hackers@postgresql.org; Mon, 08 Dec 2014 22:06:00 +0000 Received: from mail-by2on0613.outbound.protection.outlook.com ([2a01:111:f400:fc0c::613] helo=na01-by2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Xy6RH-000819-Ji for pgsql-hackers@postgresql.org; Mon, 08 Dec 2014 22:05:59 +0000 Received: from decina.local (24.55.12.91) by CY1PR11MB0348.namprd11.prod.outlook.com (25.161.165.16) with Microsoft SMTP Server (TLS) id 15.1.31.17; Mon, 8 Dec 2014 22:05:47 +0000 Message-ID: <548620B3.4030205@BlueTreble.com> Date: Mon, 8 Dec 2014 16:05:39 -0600 From: Jim Nasby User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Robert Haas , Amit Kapila CC: Amit Langote , Andres Freund , Alvaro Herrera , Bruce Momjian , Pg Hackers Subject: Re: On partitioning References: <20140829155607.GF7705@eldon.alvh.no-ip.org> <01b001cff270$d470b990$7d522cb0$@lab.ntt.co.jp> <20141028100629.GE2639@awork2.anarazel.de> <053501cffa30$ecdf8700$c69e9500$@lab.ntt.co.jp> <066501cffd52$3d919390$b8b4bab0$@lab.ntt.co.jp> <032601d00471$ea6f4280$bf4dc780$@lab.ntt.co.jp> <04da01d00917$2dde1010$899a3030$@lab.ntt.co.jp> In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [24.55.12.91] X-ClientProxiedBy: BN1PR08CA0016.namprd08.prod.outlook.com (10.242.217.144) To CY1PR11MB0348.namprd11.prod.outlook.com (25.161.165.16) X-Microsoft-Antispam: UriScan:; X-Microsoft-Antispam: BCL:0;PCL:0;RULEID:;SRVR:CY1PR11MB0348; X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:;SRVR:CY1PR11MB0348; X-Forefront-PRVS: 041963B986 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(24454002)(189002)(199003)(479174003)(377454003)(4396001)(59896002)(50986999)(54356999)(86362001)(87976001)(93886004)(20776003)(47776003)(42186005)(46102003)(64126003)(31966008)(83506001)(64706001)(62966003)(33656002)(101416001)(77156002)(50466002)(19580395003)(87266999)(21056001)(65816999)(80316001)(76176999)(66066001)(65956001)(92566001)(107046002)(120916001)(122386002)(40100003)(99396003)(106356001)(105586002)(97736003)(23676002)(15975445007)(36756003)(68736005)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:CY1PR11MB0348; H:decina.local; FPR:; SPF:None; MLV:sfv; PTR:InfoNoRecords; MX:1; A:1; LANG:en; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:;SRVR:CY1PR11MB0348; X-OriginatorOrg: bluetreble.com X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 12/8/14, 1:05 PM, Robert Haas wrote: > Besides, I haven't really seen anyone propose something that sounds > like a credible alternative. If we could make partition objects > things that the storage layer needs to know about but the query > planner doesn't need to understand, that'd be maybe worth considering. > But I don't see any way that that's remotely feasible. There are lots > of places that we assume that a heap consists of blocks number 0 up > through N: CTID pointers, index-to-heap pointers, nodeSeqScan, bits > and pieces of the way index vacuuming is handled, which in turn bleeds > into Hot Standby. You can't just decide that now block numbers are > going to be replaced by some more complex structure, or even that > they're now going to be nonlinear, without breaking a huge amount of > stuff. Agreed, but it's possible to keep a block/CTID interface while doing something different on the disk. If you think about it, partitioning is really a hack anyway. It clutters up your logical set implementation with a bunch of physical details. What most people really want when they implement partitioning is simply data locality. -- Jim Nasby, Data Architect, Blue Treble Consulting Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers