Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 350F11337B2F for ; Thu, 21 Apr 2011 17:08:19 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 35179-07 for ; Thu, 21 Apr 2011 20:08:01 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-vw0-f46.google.com (mail-vw0-f46.google.com [209.85.212.46]) by mail.postgresql.org (Postfix) with ESMTP id 2C6F9133616B for ; Thu, 21 Apr 2011 17:08:01 -0300 (ADT) Received: by vws1 with SMTP id 1so60298vws.19 for ; Thu, 21 Apr 2011 13:08:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=Teym4Z3hvr61VRblOUgfzC+okROFrcOCtrXDyby/KC8=; b=gm4WUodLFbQ+9B/QSf3anFg0AQAYZKroLxGhxBR1CrzD1MeRLXSSe120kHIKCYNiXC bdui6P00nFeJhU87aAzmCT5TsInlTZR0fsD08L6XlNGwsynjlDhWiFcDaAD0ZejQhN82 VHawe91bHZad8emCHqv5HQPnvWJlfogtW8zQ0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=aWd5DGV7nQsUGgOOTLdfGX8QLwxAZfPU92/iKj1fLjL5VG2sLsAVoGGeJS6aJFxsoG IsdXDyiYcm/2g1r2C43+Utls8p7Bpaq2Ob8RdRwqVDna/WSigtwDhxLT0FwnXA03HBRr C0S8+HK5MWwZ9SQrAb7tu9RhKaB9+hb1q6NZI= MIME-Version: 1.0 Received: by 10.52.180.195 with SMTP id dq3mr567959vdc.10.1303416480878; Thu, 21 Apr 2011 13:08:00 -0700 (PDT) Received: by 10.52.165.66 with HTTP; Thu, 21 Apr 2011 13:08:00 -0700 (PDT) In-Reply-To: References: Date: Thu, 21 Apr 2011 13:08:00 -0700 Message-ID: Subject: Re: oom_killer From: Tory M Blue To: Scott Marlowe Cc: Claudio Freire , pgsql-performance@postgresql.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.898 tagged_above=-10 required=5 tests=BAYES_00=-1.9, FREEMAIL_FROM=0.001, RFC_ABUSE_POST=0.001 X-Spam-Level: X-Archive-Number: 201104/310 X-Sequence-Number: 43372 On Thu, Apr 21, 2011 at 1:04 PM, Scott Marlowe wr= ote: > On Thu, Apr 21, 2011 at 11:15 AM, Tory M Blue wrote: > >> While I don't mind the occasional slap of reality. This configuration >> has run for 4+ years. It's possible that as many other components each >> fedora release is worse then the priors. > > How many of those 300 max connections do you generally use? =A0If you've > always used a handful, or you've used more but they weren't memory > hungry then you've been lucky. max of 45 > work_mem is how much memory postgresql can allocate PER sort or hash > type operation. =A0Each connection can do that more than once. =A0A > complex query can do it dozens of times. =A0Can you see that going from > 20 to 200 connections and increasing complexity can result in memory > usage going from a few megabytes to something like 200 connections * > 100Megabytes per sort * 3 sorts =3D 60Gigabytes. > >> The Os has changed 170 days ago from fc6 to f12, but the postgres >> configuration has been the same, and umm no way it can operate, is so >> black and white, especially when it has ran performed well with a >> decent sized data set for over 4 years. > > Just because you've been walking around with a gun pointing at your > head without it going off does not mean walking around with a gun > pointing at your head is a good idea. Yes that is what I gathered. It's good information and I'm always open to a smack if I learn something, which in this case I did. We were already working on moving to 64bit, but again the oom_killer popping up without the system even attempting to use swap is what has caused me some pause. Thanks again Tory