X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id A740256231 for ; Fri, 4 Mar 2005 22:05:27 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 11832-08 for ; Fri, 4 Mar 2005 22:05:15 +0000 (GMT) Received: from flake.decibel.org (flake.decibel.org [67.100.216.10]) by svr1.postgresql.org (Postfix) with ESMTP id C500054593 for ; Fri, 4 Mar 2005 22:05:06 +0000 (GMT) Received: by flake.decibel.org (Postfix, from userid 1001) id D10091C91F; Fri, 4 Mar 2005 16:05:07 -0600 (CST) Date: Fri, 4 Mar 2005 16:05:07 -0600 From: "Jim C. Nasby" To: Ramon Bastiaans Cc: pgsql-performance@postgresql.org Subject: Re: multi billion row tables: possible or insane? Message-ID: <20050304220507.GH2209@decibel.org> References: <42243725.6060804@sara.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <42243725.6060804@sara.nl> X-Operating-System: FreeBSD 4.10-RELEASE-p3 i386 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.6i X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.089 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200503/84 X-Sequence-Number: 10789 On Tue, Mar 01, 2005 at 10:34:29AM +0100, Ramon Bastiaans wrote: > Hi all, > > I am doing research for a project of mine where I need to store several > billion values for a monitoring and historical tracking system for a big > computer system. My currect estimate is that I have to store (somehow) > around 1 billion values each month (possibly more). On a side-note, do you need to keep the actual row-level details for history? http://rrs.decibel.org might be of some use. Other than that, what others have said. Lots and lots of disks in RAID10, and opterons (though I would choose opterons not for memory size but because of memory *bandwidth*). -- Jim C. Nasby, Database Consultant decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?"