Received: from localhost (unknown [200.46.204.183]) by mail.postgresql.org (Postfix) with ESMTP id 1C2F864FE97 for ; Wed, 24 Dec 2008 14:56:32 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 62581-04 for ; Wed, 24 Dec 2008 14:56:29 -0400 (AST) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.233]) by mail.postgresql.org (Postfix) with ESMTP id 8732D64FD3D for ; Wed, 24 Dec 2008 14:56:29 -0400 (AST) Received: by rv-out-0506.google.com with SMTP id b25so4472166rvf.43 for ; Wed, 24 Dec 2008 10:56:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type:references; bh=L7k0x9Qn4i5xraaAtmzWi+/po6oYJeUnLqsXLWGOegM=; b=cNQDgEw4lMePCzM+wJyhwKDqUszAP1kOZn0Z8pWR1dfecYA9ozEORFz124LjnlqBSr MkJJv+04ywHHbQYir730cu2wlr0wdGgZ41+bU9cR26WJ7TjLmFH3Cb6vkEu451ubrLMq TChxFUfvqDCw5YA0mkMSGZo4JQkrLyltg/EtQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:references; b=H/zO6yZ0SFdWKthqJL3fYgJYYj5Mf/bpobYzMRXVQflRpflqoeWZbEvYZczoL7DDjZ jeH8LMouxWx0uZwasG5h1/qG2tEEJDeSAKiDkrUnf5VrR2oIeRRRKMYZGRdwo1ckWS6W xoE0rcLbz03XUKKFg+GJxoCokph/uUZaE578g= Received: by 10.141.53.1 with SMTP id f1mr4412325rvk.4.1230144988242; Wed, 24 Dec 2008 10:56:28 -0800 (PST) Received: by 10.141.123.6 with HTTP; Wed, 24 Dec 2008 10:56:28 -0800 (PST) Message-ID: Date: Wed, 24 Dec 2008 13:56:28 -0500 From: "Kynn Jones" To: pgsql-performance@postgresql.org Subject: Re: How to "unique-ify" HUGE table? In-Reply-To: <49514058.9090005@kaltenbrunner.cc> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_76711_33131394.1230144988233" References: <8C5B026B51B6854CBE88121DBF097A86033B2DED@ehost010-33.exch010.intermedia.net> <49514058.9090005@kaltenbrunner.cc> X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0.001 tagged_above=0 required=5 tests=HTML_MESSAGE=0.001 X-Spam-Level: X-Archive-Number: 200812/211 X-Sequence-Number: 32247 ------=_Part_76711_33131394.1230144988233 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Thank you all for the very helpful advice. Upping work_mem made it possible for me to generate the table within this century without bringing the server to a near standstill. I have not yet experimented with GROUP BY, but I'll do this next. Cheers, Kynn ------=_Part_76711_33131394.1230144988233 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Thank you all for the very helpful advice.  Upping work_mem made it possible for me to generate the table within this century without bringing the server to a near standstill.  I have not yet experimented with GROUP BY, but I'll do this next.

Cheers,

Kynn

------=_Part_76711_33131394.1230144988233--