Received: from localhost (unknown [200.46.204.183]) by developer.postgresql.org (Postfix) with ESMTP id 2BA552E022D for ; Fri, 16 May 2008 05:18:15 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 39304-05 for ; Fri, 16 May 2008 05:17:57 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from outmail136025.authsmtp.co.uk (outmail136025.authsmtp.co.uk [62.13.136.25]) by developer.postgresql.org (Postfix) with ESMTP id D54CA2E0192 for ; Fri, 16 May 2008 04:36:55 -0300 (ADT) Received: from mail-c187.authsmtp.com (mail-c187.authsmtp.com [62.13.128.33]) by punt3.authsmtp.com (8.13.8/8.13.8/Kp) with ESMTP id m4G7aqeP050837; Fri, 16 May 2008 08:36:52 +0100 (BST) Received: from [192.168.0.6] (85-211-226-243.dyn.gotadsl.co.uk [85.211.226.243]) (authenticated bits=0) by mail.authsmtp.com (8.14.2/8.14.2/Kp) with ESMTP id m4G7apI4075145; Fri, 16 May 2008 08:36:51 +0100 (BST) Subject: Re: Join runs for > 10 hours and then fills up >1.3TB of disk space From: Simon Riggs To: kevin kempter Cc: pgsql-performance@postgresql.org In-Reply-To: References: Content-Type: text/plain Date: Fri, 16 May 2008 08:38:30 +0100 Message-Id: <1210923510.8820.17.camel@ebony.site> Mime-Version: 1.0 X-Mailer: Evolution 2.12.0 Content-Transfer-Encoding: 7bit X-Server-Quench: d99b885e-231a-11dd-8782-001185d377ca X-AuthRoute: OCdxZQATClZOTQEd DAteCiNZVAwpPBRK HVkIKg5MJUcNSQVJ NksadBtFaQNbYFhI HGQLW1xEUFV7WmV/ bgsfZQBDYEtPQQdo VlZLRlFNFgB3AVJc AmkZA1kLcwVBfX90 YAhjXXVZEhBzfBR1 SksBCG8FZDZ9aWFL BF1QcAtWbQNKfx5N bwR8U3ReMCtlM3Bw LDceBR4WBxBqYAZS QwdFN08UWg4FGSR0 EVhbRX0vGlAfXG06 KRBuNl4RGg4fM0E2 KhM8QRpOallJNicW GE8vYSNYPFpJXDIi Bg4y X-Authentic-SMTP: 61633235383639.squirrel.dmpriest.net.uk:953/Kp X-Report-SPAM: If SPAM / abuse - report it at: http://www.authsmtp.com/abuse X-Virus-Status: No virus detected - but ensure you scan with your own anti-virus system! X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200805/237 X-Sequence-Number: 30205 On Fri, 2008-05-16 at 00:31 -0600, kevin kempter wrote: > I'm running the join shown below and it takes > 10 hours and > eventually runs out of disk space on a 1.4TB file system Well, running in 10 hours doesn't mean there's a software problem, nor does running out of disk space. Please crunch some numbers before you ask, such as how much disk space was used by the query, how big you'd expect it to be etc, plus provide information such as what the primary key of the large table is and what is your release level is etc.. Are you sure you want to retrieve an estimated 3 billion rows? Can you cope if that estimate is wrong and the true figure is much higher? Do you think the estimate is realistic? -- Simon Riggs www.2ndQuadrant.com PostgreSQL Training, Services and Support