Received: from localhost (unknown [200.46.204.184]) by developer.postgresql.org (Postfix) with ESMTP id 8101B2E008D for ; Tue, 22 Apr 2008 13:21:16 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.184]) (amavisd-maia, port 10024) with ESMTP id 83165-03 for ; Tue, 22 Apr 2008 13:21:08 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.5 Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.231]) by developer.postgresql.org (Postfix) with ESMTP id 9A6322E0083 for ; Tue, 22 Apr 2008 13:21:08 -0300 (ADT) Received: by wx-out-0506.google.com with SMTP id r21so1863315wxc.28 for ; Tue, 22 Apr 2008 09:21:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type; bh=4CRxK0zPqOd3YHGfQomgZZ2/dp/GCkT/oi7dJ8o51bQ=; b=bw6x9U8a4p7FrOkZPkIvkJaesL3CG5VW8+ZC2poXngQg9zrA13JXOAqYJEF2po6CjoeCH/55TFaM0xiWaoS69GqNF2goNMpAGvVL8pyfSb8/phgufPhjytHF3fymkq6rTSk8ktpmeBwI1w7YB35XS6Du5t16KsDlJ17PYX/aY68= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type; b=AiCXtC+6csIMVysZjEhEncnvPFBROq38LhEMgj6tSOjrdDb8eIBoTth1tlZSZC96u5/TJYxFjJvPKeI3SzYlkHAl69QYfABTmHfnyL54ggtcFtlNttUKfzEYHX3QjGIwKFG0Zp7CmOe66g4fFtOr2Tlr0D4MHymmtLt0YvaJ5gA= Received: by 10.100.108.20 with SMTP id g20mr654497anc.106.1208881267426; Tue, 22 Apr 2008 09:21:07 -0700 (PDT) Received: from ?190.17.15.92? ( [190.17.15.92]) by mx.google.com with ESMTPS id c9sm8969534ana.35.2008.04.22.09.20.59 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 22 Apr 2008 09:21:00 -0700 (PDT) Message-ID: <480E106F.6020704@gmail.com> Date: Tue, 22 Apr 2008 13:21:03 -0300 From: Rodrigo Gonzalez User-Agent: Thunderbird 2.0.0.12 (Windows/20080213) MIME-Version: 1.0 To: Bryan Buecking CC: Erik Jones , pgsql-performance@postgresql.org Subject: Re: CPU bound at 99% References: <20080422153045.GB5961@starling-software.com> <20080422161020.GE5961@starling-software.com> In-Reply-To: <20080422161020.GE5961@starling-software.com> Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="------------ms040003000403080006090001" X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200804/325 X-Sequence-Number: 29818 This is a cryptographically signed message in MIME format. --------------ms040003000403080006090001 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Are tables vacuumed often? Bryan Buecking escribi=F3: > On Tue, Apr 22, 2008 at 10:55:19AM -0500, Erik Jones wrote: > =20 >> On Apr 22, 2008, at 10:31 AM, Bryan Buecking wrote: >> >> =20 >>> max_connections =3D 2400 >>> =20 >> That is WAY too high. Get a real pooler, such as pgpool, and drop =20 >> that down to 1000 and test from there. >> =20 > > I agree, but the number of idle connections dont' seem to affect > performace only memory usage. I'm trying to lessen the load of > connection setup. But sounds like this tax is minimal? > > When these issues started happening, max_connections was set to 1000 an= d > I was not using persistent connections. > > =20 >> I see you mentioned 500 concurrent connections. Are each of those >> connections actually doing something? >> =20 > > Yes out of the 2400 odd connections, 500 are either in SELECT or RESET.= > > =20 >> My guess that once you cut down on the number actual connections >> you'll find that each connection can get it's work done faster >> and you'll see that number drop significantly. >> =20 > > I agree, but not in this case. I will look at using pooling.=20 > =20 --------------ms040003000403080006090001 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIJCzCC AuAwggJJoAMCAQICEFKu3/n0oTKNim1sXE5AIgswDQYJKoZIhvcNAQEFBQAwYjELMAkGA1UE BhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMT I1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA3MDkwNTEyMzIyNFoX DTA4MDkwNDEyMzIyNFowRTEfMB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEiMCAG CSqGSIb3DQEJARYTcmpnb256YWxlQGdtYWlsLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEP ADCCAQoCggEBALjktG7EMWR5pPz82DfSue+kNXszsWfpEWrRtFt0jBM01Pz6tiYVTy1IMgxl R03UOuGdOkyqK9TkLxCbN80I0xBbM/1r4Z35FJ/EN+Vm/DPBGOwuxJEw4Dj8/5uDrPkRVC0b j+YRxZsM4TOJjIrrqO/6xPRe4pns+gYvHdcW98mR2hyeTIBnx7WcQfPUMOzmPUt/nJNakxgH A1B2724RMeGQpMh8pHUJ7B04RNt+f3sLzr9c+a815AhdNqPPMjmcnkRtjcdCK3K+dngtQzp4 TbiUnUBQtjCvF31EK75NcbRJdGZhJCRjsjJtW5Nep9TJ7tBrTHUxNEDt11cDJnLe4i8CAwEA AaMwMC4wHgYDVR0RBBcwFYETcmpnb256YWxlQGdtYWlsLmNvbTAMBgNVHRMBAf8EAjAAMA0G CSqGSIb3DQEBBQUAA4GBAKX5592Z5SwMOtNc99oEJGEPwk8K2/z/0G8VSkJoWR1rYxWvBF7+ biHZ4T7sQBUw0FUgyWV+swc/DtTDZDr+J2WWKIcMFMRHX+Fmo7SyqPWL1+jhmSolbWoq6eHj U2YOxPDJflcl8okL5b85y4m9lsCHS0qtIZ1KJ5oFod1zFOxlMIIC4DCCAkmgAwIBAgIQUq7f +fShMo2KbWxcTkAiCzANBgkqhkiG9w0BAQUFADBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMc VGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFs IEZyZWVtYWlsIElzc3VpbmcgQ0EwHhcNMDcwOTA1MTIzMjI0WhcNMDgwOTA0MTIzMjI0WjBF MR8wHQYDVQQDExZUaGF3dGUgRnJlZW1haWwgTWVtYmVyMSIwIAYJKoZIhvcNAQkBFhNyamdv bnphbGVAZ21haWwuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuOS0bsQx ZHmk/PzYN9K576Q1ezOxZ+kRatG0W3SMEzTU/Pq2JhVPLUgyDGVHTdQ64Z06TKor1OQvEJs3 zQjTEFsz/WvhnfkUn8Q35Wb8M8EY7C7EkTDgOPz/m4Os+RFULRuP5hHFmwzhM4mMiuuo7/rE 9F7imez6Bi8d1xb3yZHaHJ5MgGfHtZxB89Qw7OY9S3+ck1qTGAcDUHbvbhEx4ZCkyHykdQns HThE235/ewvOv1z5rzXkCF02o88yOZyeRG2Nx0Ircr52eC1DOnhNuJSdQFC2MK8XfUQrvk1x tEl0ZmEkJGOyMm1bk16n1Mnu0GtMdTE0QO3XVwMmct7iLwIDAQABozAwLjAeBgNVHREEFzAV gRNyamdvbnphbGVAZ21haWwuY29tMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQEFBQADgYEA pfnn3ZnlLAw601z32gQkYQ/CTwrb/P/QbxVKQmhZHWtjFa8EXv5uIdnhPuxAFTDQVSDJZX6z Bz8O1MNkOv4nZZYohwwUxEdf4WajtLKo9YvX6OGZKiVtairp4eNTZg7E8Ml+VyXyiQvlvznL ib2WwIdLSq0hnUonmgWh3XMU7GUwggM/MIICqKADAgECAgENMA0GCSqGSIb3DQEBBQUAMIHR MQswCQYDVQQGEwJaQTEVMBMGA1UECBMMV2VzdGVybiBDYXBlMRIwEAYDVQQHEwlDYXBlIFRv d24xGjAYBgNVBAoTEVRoYXd0ZSBDb25zdWx0aW5nMSgwJgYDVQQLEx9DZXJ0aWZpY2F0aW9u IFNlcnZpY2VzIERpdmlzaW9uMSQwIgYDVQQDExtUaGF3dGUgUGVyc29uYWwgRnJlZW1haWwg Q0ExKzApBgkqhkiG9w0BCQEWHHBlcnNvbmFsLWZyZWVtYWlsQHRoYXd0ZS5jb20wHhcNMDMw NzE3MDAwMDAwWhcNMTMwNzE2MjM1OTU5WjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhh d3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZy ZWVtYWlsIElzc3VpbmcgQ0EwgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJAoGBAMSmPFVzVftO ucqZWh5owHUEcJ3f6f+jHuy9zfVb8hp2vX8MOmHyv1HOAdTlUAow1wJjWiyJFXCO3cnwK4Va qj9xVsuvPAsH5/EfkTYkKhPPK9Xzgnc9A74r/rsYPge/QIACZNenprufZdHFKlSFD0gEf6e2 0TxhBEAeZBlyYLf7AgMBAAGjgZQwgZEwEgYDVR0TAQH/BAgwBgEB/wIBADBDBgNVHR8EPDA6 MDigNqA0hjJodHRwOi8vY3JsLnRoYXd0ZS5jb20vVGhhd3RlUGVyc29uYWxGcmVlbWFpbENB LmNybDALBgNVHQ8EBAMCAQYwKQYDVR0RBCIwIKQeMBwxGjAYBgNVBAMTEVByaXZhdGVMYWJl bDItMTM4MA0GCSqGSIb3DQEBBQUAA4GBAEiM0VCD6gsuzA2jZqxnD3+vrL7CF6FDlpSdf0wh uPg2H6otnzYvwPQcUCCTcDz9reFhYsPZOhl+hLGZGwDFGguCdJ4lUJRix9sncVcljd2pnDmO jCBPZV+V2vf3h9bGCE6u9uo05RAaWzVNd+NWIXiC3CEZNd4ksdMdRv9dX2VPMYIDZDCCA2AC AQEwdjBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkg THRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIElzc3VpbmcgQ0ECEFKu 3/n0oTKNim1sXE5AIgswCQYFKw4DAhoFAKCCAcMwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMDgwNDIyMTYyMTAzWjAjBgkqhkiG9w0BCQQxFgQU5JuriMRx OujrXR1tLwlZ6ewFjwowUgYJKoZIhvcNAQkPMUUwQzAKBggqhkiG9w0DBzAOBggqhkiG9w0D AgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwgYUGCSsGAQQB gjcQBDF4MHYwYjELMAkGA1UEBhMCWkExJTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQ dHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENB AhBSrt/59KEyjYptbFxOQCILMIGHBgsqhkiG9w0BCRACCzF4oHYwYjELMAkGA1UEBhMCWkEx JTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0 ZSBQZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBAhBSrt/59KEyjYptbFxOQCILMA0GCSqG SIb3DQEBAQUABIIBAKmtQX+6X6pRZob6pMjQVlFnimgjshz99nYH3krUkaUae6omUC6dAILt osKI4c/IraQ9990/zGPqYFB15SSWdUTre7Dyy4+3ofj5nqdMczy54WZ4iqz1b8m75U5KWnrP ZbKqyi8aGGvkK0v1J2zO7t2tp9JYLT4pH07mqEvAuuAT1MuyjLKG/jQvdaDXHkqAPPX+S/zW 23Qw6tE7Th0Lu0sOA4MBRNkFTkpMJeaNTe/6N3k76zts7d9oGsSaeI1qU5gsffovMWck6DNL +8IX+CqKyI1aCNbn/5fNf6g0FPqozgdCrQBykP+R6q3kRClsLf+qHUX22D41oeQvlcFhl8EA AAAAAAA= --------------ms040003000403080006090001--