X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id D70D6D1B18F for ; Tue, 22 Jun 2004 14:30:30 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 75487-07 for ; Tue, 22 Jun 2004 17:30:27 +0000 (GMT) Received: from math.uchicago.edu (math.uchicago.edu [128.135.72.38]) by svr1.postgresql.org (Postfix) with ESMTP id 0C665D1B1E0 for ; Tue, 22 Jun 2004 14:30:21 -0300 (ADT) Received: from billnotebook (wireless-199-135.uchicago.edu [128.135.199.135]) by math.uchicago.edu (8.12.10/8.12.10) with SMTP id i5MHUHfM019307; Tue, 22 Jun 2004 12:30:20 -0500 Message-ID: <008201c4587e$b8856510$dfc58780@billnotebook> From: "Bill" To: "Josh Berkus" Cc: References: <004001c45865$59cc9f20$dfc58780@billnotebook> <200406220931.23780.josh@agliodbs.com> Subject: Re: postgresql and openmosix migration Date: Tue, 22 Jun 2004 12:31:15 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1409 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1409 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200406/230 X-Sequence-Number: 7288 Ok, so maybe someone on this group will have a better idea. We have a database of financial information, and this has literally millions of entries. I have installed indicies, but for the rather computationally demanding processes we like to use, like a select query to find the commodity with the highest monthly or annual returns, the computer generally runs unacceptably slow. So, other than clustring, how could I achieve a speed increase in these complex queries? Is this better in mysql or postgresql? Thanks. ----- Original Message ----- From: "Josh Berkus" To: "Bill" ; Sent: Tuesday, June 22, 2004 11:31 AM Subject: Re: [PERFORM] postgresql and openmosix migration > Bill, > > > Any ideas of how I can cluster my database (around 800 GB > > in size so even partial replication is not really practical)? > > Um, raise $150,000 to pay for a clustering implementation? > > Various techniques of "shared memory clustering" have been tried with > PostgreSQL, and none work. Neither does LinuxLabs "ClusGres", which is > based on similar principles -- unfortunately. (at least, LL repeatedly > postponed the demo they said they'd give me. I've yet to see anything > working ...) > > Frankly, we're waiting for a well-funded corporation to jump in and decide > they want PostgreSQL clustering. Database server clustering is a "big > ticket item" requiring roughly 1,000 hours of programming and > troubleshooting. As such, you're not likely to see it come out of the OSS > community unaided. > > Oh, and FYI, MySQL's "clustering" doesn't work either. It requires your > entire database to fit into available RAM .... > > -- > Josh Berkus > Aglio Database Solutions > San Francisco >