X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 13A81329E3A for ; Fri, 24 Sep 2004 01:40:16 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 38602-08 for ; Fri, 24 Sep 2004 00:40:10 +0000 (GMT) Received: from hosting.commandprompt.com (128.commandprompt.com [207.173.200.128]) by svr1.postgresql.org (Postfix) with ESMTP id 16E10329E32 for ; Fri, 24 Sep 2004 01:40:12 +0100 (BST) Received: from [192.168.1.20] (clbb-248.saw.net [64.146.135.248]) (authenticated) by hosting.commandprompt.com (8.11.6/8.11.6) with ESMTP id i8O0e1818250; Thu, 23 Sep 2004 17:40:01 -0700 Message-ID: <41536C4A.2010702@commandprompt.com> Date: Thu, 23 Sep 2004 17:37:30 -0700 From: "Joshua D. Drake" Organization: Command Prompt, Inc. User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Josh Berkus Cc: Jason Coene , pgsql-performance@postgresql.org, mendola@bigfoot.com, tgl@sss.pgh.pa.us Subject: Re: Caching of Queries References: In-Reply-To: Content-Type: multipart/alternative; boundary="------------070605060102080306070907" X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.5 tagged_above=0.0 required=5.0 tests=HTML_MESSAGE, HTML_TITLE_EMPTY X-Spam-Level: X-Archive-Number: 200409/263 X-Sequence-Number: 8391 This is a multi-part message in MIME format. --------------070605060102080306070907 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit >>Sorry, I meant 30,000 with 300 connections - not 3,000. The 300 >>connections >>/ second is realistic, if not underestimated. As is the nature of >>our site >>(realtime information about online gaming), there's a huge fan base >>and as a >>big upset happens, we'll do 50,000 page views in a span of 3-5 >>minutes. >> >> > >First, your posts show no evidences of the CS storm bug. > >Second, 300 *new* connections a second is a lot. Each new connection >requires a significant amount of both database and OS overhead. This >is why all the other web developers use a connection pool. > > > I would second this. You need to be running a connection pool and probably multiple web servers in front of that. You are talking about a huge amount of connections in that amount of time. Josh Drake >In fact, I wouldn't be surprised if your lockups are on the OS level, >even; I don't recall that you cited what OS you're using, but I can >imagine locking up Linux 2.4 trying to spawn 300 new processes a >second. > >--Josh > >---------------------------(end of broadcast)--------------------------- >TIP 8: explain analyze is your friend > > -- Command Prompt, Inc., home of Mammoth PostgreSQL - S/ODBC and S/JDBC Postgresql support, programming shared hosting and dedicated hosting. +1-503-667-4564 - jd@commandprompt.com - http://www.commandprompt.com PostgreSQL Replicator -- production quality replication for PostgreSQL --------------070605060102080306070907 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit
Sorry, I meant 30,000 with 300 connections - not 3,000.  The 300
connections
/ second is realistic, if not underestimated.  As is the nature of
our site
(realtime information about online gaming), there's a huge fan base
and as a
big upset happens, we'll do 50,000 page views in a span of 3-5
minutes.
    

First, your posts show no evidences of the CS storm bug.

Second, 300 *new* connections a second is a lot.   Each new connection
requires a significant amount of both database and OS overhead.   This
is why all the other web developers use a connection pool.

  
I would second this. You need to be running a connection pool and probably multiple web servers in
front of that. You are talking about a huge amount of connections in that amount of time.

Josh Drake



In fact, I wouldn't be surprised if your lockups are on the OS level,
even; I don't recall that you cited what OS you're using, but I can
imagine locking up Linux 2.4 trying to spawn 300 new processes a
second.

--Josh

---------------------------(end of broadcast)---------------------------
TIP 8: explain analyze is your friend
  


-- 
Command Prompt, Inc., home of Mammoth PostgreSQL - S/ODBC and S/JDBC
Postgresql support, programming shared hosting and dedicated hosting.
+1-503-667-4564 - jd@commandprompt.com - http://www.commandprompt.com
PostgreSQL Replicator -- production quality replication for PostgreSQL
--------------070605060102080306070907--