Received: from maia.hub.org (maia-3.hub.org [200.46.204.243])
	by mail.postgresql.org (Postfix) with ESMTP id 454231337BD4
	for <pgsql-performance-postgresql.org@mail.postgresql.org>;
	Thu,  7 Oct 2010 15:38:24 -0300 (ADT)
Received: from mail.postgresql.org ([200.46.204.86])
	by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia,
	port 10024) with ESMTP id 66220-05
	for <pgsql-performance-postgresql.org@mail.postgresql.org>;
	Thu,  7 Oct 2010 18:38:16 +0000 (UTC)
X-Greylist: delayed 00:08:34.402441 by SQLgrey-1.7.6
Received: from crestone.coronasolutions.com (crestone.coronasolutions.com
	[66.45.104.24])
	by mail.postgresql.org (Postfix) with ESMTP id CADF61337B5C
	for <pgsql-performance@postgresql.org>;
	Thu,  7 Oct 2010 15:38:16 -0300 (ADT)
Received: from localhost (localhost.localdomain [127.0.0.1])
	by crestone.coronasolutions.com (Postfix) with ESMTP id 4CF2A4E255
	for <pgsql-performance@postgresql.org>;
	Thu,  7 Oct 2010 12:29:40 -0600 (MDT)
X-Virus-Scanned: Debian amavisd-new at coronasolutions.com
Received: from crestone.coronasolutions.com ([127.0.0.1])
	by localhost (localhost.localdomain [127.0.0.1]) (amavisd-new,
	port 10024)
	with ESMTP id PyhysWCrQEcB for <pgsql-performance@postgresql.org>;
	Thu,  7 Oct 2010 12:29:39 -0600 (MDT)
Received: from mac.local (unknown [10.1.250.14])
	by crestone.coronasolutions.com (Postfix) with ESMTPA id E5BFF4E1AB
	for <pgsql-performance@postgresql.org>;
	Thu,  7 Oct 2010 12:29:38 -0600 (MDT)
Message-ID: <4CAE1192.5080807@drivefaster.net>
Date: Thu, 07 Oct 2010 12:29:38 -0600
From: Dan Harris <fbsd@drivefaster.net>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US;
	rv:1.9.2.9) Gecko/20100915 Lightning/1.0b2 Thunderbird/3.1.4
MIME-Version: 1.0
To: pgsql-performance <pgsql-performance@postgresql.org>
Subject: Re: large dataset with write vs read clients
References: <AANLkTimNJc=0ffgRO_gO6Vsq06=aqBYXZouhbv0kBe-i@mail.gmail.com>
In-Reply-To: <AANLkTimNJc=0ffgRO_gO6Vsq06=aqBYXZouhbv0kBe-i@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Virus-Scanned: Maia Mailguard 1.0.1
X-Spam-Status: No, hits=-1.9 tagged_above=-10 required=5 tests=BAYES_00=-1.9
X-Spam-Level: 
X-Archive-Number: 201010/62
X-Sequence-Number: 40481

  On 10/7/10 11:47 AM, Aaron Turner wrote:
> <snip>
>
> Basically, each connection is taking about 100MB resident.  As we need
> to increase the number of threads to be able to query all the devices
> in the 5 minute window, we're running out of memory.
I think the first thing to do is look into using a connection pooler 
like pgpool to reduce your connection memory overhead.

-Dan