X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 3F1A132B22A for ; Fri, 22 Oct 2004 04:30:20 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 63835-05 for ; Fri, 22 Oct 2004 03:30:07 +0000 (GMT) Received: from linuxworld.com.au (unknown [203.34.46.50]) by svr1.postgresql.org (Postfix) with ESMTP id 60C9A32A681 for ; Fri, 22 Oct 2004 04:30:08 +0100 (BST) Received: from localhost (swm@localhost) by linuxworld.com.au (8.11.6/8.11.4) with ESMTP id i9M3TvN31573; Fri, 22 Oct 2004 13:29:57 +1000 Date: Fri, 22 Oct 2004 13:29:57 +1000 (EST) From: Gavin Sherry X-X-Sender: swm@linuxworld.com.au To: Joshua Marsh Cc: pgsql-performance@postgresql.org Subject: Re: Large Database Performance suggestions In-Reply-To: <38242de904102120143c55ba34@mail.gmail.com> Message-ID: References: <38242de904102120143c55ba34@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200410/374 X-Sequence-Number: 8850 On Thu, 21 Oct 2004, Joshua Marsh wrote: > Recently, we have found customers who are wanting to use our service > with data files between 100 million and 300 million records. At that > size, each of the three major tables will hold between 150 million and > 700 million records. At this size, I can't expect it to run queries > in 10-15 seconds (what we can do with 10 million records), but would > prefer to keep them all under a minute. To provide any useful information, we'd need to look at your table schemas and sample queries. The values for sort_mem and shared_buffers will also be useful. Are you VACUUMing and ANALYZEing? (or is the data read only?)) gavin