X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 82A583A47A3 for ; Thu, 20 Jan 2005 15:14:52 +0000 (GMT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 13120-04 for ; Thu, 20 Jan 2005 15:14:31 +0000 (GMT) Received: from noao.edu (dns.noao.edu [140.252.1.54]) by svr1.postgresql.org (Postfix) with ESMTP id 5749B3A47FC for ; Thu, 20 Jan 2005 15:14:34 +0000 (GMT) X-TFF-CGPSA-Version: 1.4f1 X-TFF-CGPSA-Filter: Scanned Received: from [140.252.14.8] (HELO weaver.tuc.noao.edu) by noao.edu (CommuniGate Pro SMTP 4.2.8) with ESMTP-TLS id 16152929; Thu, 20 Jan 2005 08:14:33 -0700 Received: from [127.0.0.1] (localhost.localdomain [127.0.0.1]) by weaver.tuc.noao.edu (8.12.8/8.12.8) with ESMTP id j0KFES32016514; Thu, 20 Jan 2005 08:14:28 -0700 Message-ID: <41EFCAD4.6040307@noao.edu> Date: Thu, 20 Jan 2005 08:14:28 -0700 From: Steve Wampler User-Agent: Mozilla Thunderbird 1.0 (X11/20041206) X-Accept-Language: en-us, en MIME-Version: 1.0 To: =?ISO-8859-15?Q?Herv=E9_Piedvache?= Cc: "Joshua D. Drake" , pgsql-performance@postgresql.org Subject: Re: PostgreSQL clustering VS MySQL clustering References: <200501201503.31241.herve@elma.fr> <41EFC3C0.6080903@commandprompt.com> <200501201600.47583.herve@elma.fr> In-Reply-To: <200501201600.47583.herve@elma.fr> X-Enigmail-Version: 0.90.0.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 8bit X-noao.edu-MailScanner-Information: Please contact the ISP for more information X-noao.edu-MailScanner: Found to be clean X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.013 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200501/294 X-Sequence-Number: 9984 Hervé Piedvache wrote: > > No ... as I have said ... how I'll manage a database getting a table of may be > 250 000 000 records ? I'll need incredible servers ... to get quick access or > index reading ... no ? > > So what we would like to get is a pool of small servers able to make one > virtual server ... for that is called a Cluster ... no ? > > I know they are not using PostgreSQL ... but how a company like Google do to > get an incredible database in size and so quick access ? Probably by carefully partitioning their data. I can't imagine anything being fast on a single table in 250,000,000 tuple range. Nor can I really imagine any database that efficiently splits a single table across multiple machines (or even inefficiently unless some internal partitioning is being done). So, you'll have to do some work at your end and not just hope that a "magic bullet" is available. Once you've got the data partitioned, the question becomes one of how to inhance performance/scalability. Have you considered RAIDb? -- Steve Wampler -- swampler@noao.edu The gods that smiled on your birth are now laughing out loud.