X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 3240954C58 for ; Tue, 1 Mar 2005 09:34:50 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 81457-04 for ; Tue, 1 Mar 2005 09:34:31 +0000 (GMT) Received: from mta.sara.nl (mta.sara.nl [145.100.16.144]) by svr1.postgresql.org (Postfix) with ESMTP id 88741564C5 for ; Tue, 1 Mar 2005 09:34:29 +0000 (GMT) Received: from [145.100.6.93] (bastiaans.ka.sara.nl [145.100.6.93]) by mta.sara.nl (8.12.10+Sun/8.12.10) with ESMTP id j219YUWk020408 for ; Tue, 1 Mar 2005 10:34:30 +0100 (MET) Message-ID: <42243725.6060804@sara.nl> Date: Tue, 01 Mar 2005 10:34:29 +0100 From: Ramon Bastiaans User-Agent: Mozilla Thunderbird 0.9 (Windows/20041103) X-Accept-Language: en-us, en MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: multi billion row tables: possible or insane? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at hub.org X-Archive-Number: 200503/4 X-Sequence-Number: 10709 Hi all, I am doing research for a project of mine where I need to store several billion values for a monitoring and historical tracking system for a big computer system. My currect estimate is that I have to store (somehow) around 1 billion values each month (possibly more). I was wondering if anyone has had any experience with these kind of big numbers of data in a postgres sql database and how this affects database design and optimization. What would be important issues when setting up a database this big, and is it at all doable? Or would it be a insane to think about storing up to 5-10 billion rows in a postgres database. The database's performance is important. There would be no use in storing the data if a query will take ages. Query's should be quite fast if possible. I would really like to hear people's thoughts/suggestions or "go see a shrink, you must be mad" statements ;) Kind regards, Ramon Bastiaans