Received: from localhost (unknown [200.46.204.183]) by postgresql.org (Postfix) with ESMTP id 7ACDF2E1374 for ; Tue, 11 Dec 2007 07:11:32 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 37558-04 for ; Tue, 11 Dec 2007 07:11:29 -0400 (AST) Received: from outmail136011.authsmtp.com (outmail136011.authsmtp.com [62.13.136.11]) by postgresql.org (Postfix) with ESMTP id 68AF92E17F6 for ; Tue, 11 Dec 2007 07:11:28 -0400 (AST) Received: from outmail128181.authsmtp.net (outmail128181.authsmtp.net [62.13.128.181]) by punt3.authsmtp.com (8.13.8/8.13.8/Kp) with ESMTP id lBBBBQkx071015 for ; Tue, 11 Dec 2007 11:11:26 GMT Received: from [192.168.0.3] (85-211-24-246.dyn.gotadsl.co.uk [85.211.24.246]) (authenticated bits=0) by mail.authsmtp.com (8.13.8/8.13.8/Kp) with ESMTP id lBBBBPNm083776 for ; Tue, 11 Dec 2007 11:11:25 GMT Subject: VLDB Features From: Simon Riggs To: pgsql-hackers@postgresql.org Content-Type: text/plain Date: Tue, 11 Dec 2007 11:11:48 +0000 Message-Id: <1197371508.4255.1327.camel@ebony.site> Mime-Version: 1.0 X-Mailer: Evolution 2.8.2 Content-Transfer-Encoding: 7bit X-Server-Quench: d06287d8-a7d9-11dc-814e-001185d377ca X-AuthRoute: OCdxZQATClZOTQEd DAteCiNZVAwpPBRK HVkIKg5MOFUSTAAU Mk9RLVdJK3UEQkpF VCReGBUITgIzDi10 ahUlOFZCYEpOWBVr UUJIQ1hQEktgBAID Bx8AUB1sdQFAZ3x1 ekYsAgIpLjYaCxt9 Sk1TEmtIZGBjYS5L UEZafwQAeB4beUtM d1F+ACAQaWQDM2dg R1Zqb209ZmoAIy1D fCUhBxo8TE8XAyQx XHhs X-Authentic-SMTP: 61633235383639.squirrel.dmpriest.net.uk:787/Kp X-Report-SPAM: If SPAM / abuse - report it at: http://www.authsmtp.com/abuse X-Virus-Status: No virus detected - but ensure you scan with your own anti-virus system! X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200712/377 X-Sequence-Number: 111666 I'm starting work on next projects for 8.4. Many applications have the need to store very large data volumes for both archival and analysis. The analytic databases are commonly known as Data Warehouses, though there isn't a common term for large archival data stores. The use cases for those can often be blurred and many people see those as only one use case. My initial interest is in the large archival data stores. One of the main issues to be faced is simply data maintenance and management. Loading, deleting, vacuuming data all takes time. Those issues relate mainly to the size of the data store rather than any particular workload, so I'm calling that set of required features "Very Large Database" (or VLDB) features. VLDB Features I'm expecting to work on are - Read Only Tables/WORM tables - Advanced Partitioning - Compression plus related performance features Details of those will be covered in separate mails over next few weeks and months. So just to let everybody know that's where I'm headed, so you see the big picture with me. I'll be working on other projects as well, many of which I've listed here: http://developer.postgresql.org/index.php/Simon_Riggs% 27_Development_Projects I expect the list is too long to complete for 8.4, but I'm allowing for various issues arising during development. So specific discussion on other mails as they arrive, please. -- Simon Riggs 2ndQuadrant http://www.2ndQuadrant.com