Received: from maia.hub.org (unknown [200.46.204.183]) by mail.postgresql.org (Postfix) with ESMTP id 3A290633923 for ; Mon, 3 Aug 2009 11:20:44 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 23395-02 for ; Mon, 3 Aug 2009 14:20:33 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from exprod7og111.obsmtp.com (exprod7og111.obsmtp.com [64.18.2.175]) by mail.postgresql.org (Postfix) with SMTP id 08EE663505C for ; Mon, 3 Aug 2009 11:20:31 -0300 (ADT) Received: from source ([209.85.222.173]) by exprod7ob111.postini.com ([64.18.6.12]) with SMTP ID DSNKSnbyKqXlgjiYHJdu03EW3DbcF6ObPE4H@postini.com; Mon, 03 Aug 2009 07:20:32 PDT Received: by mail-pz0-f173.google.com with SMTP id 3so2294208pzk.22 for ; Mon, 03 Aug 2009 07:20:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.201.3 with SMTP id y3mr445087wff.16.1249309226065; Mon, 03 Aug 2009 07:20:26 -0700 (PDT) In-Reply-To: <9837222c0908030716r416d789ewef3f77c65b39d916@mail.gmail.com> References: <200907311459.n6VExuSa036743@wwwmaster.postgresql.org> <20090731234901.GD11098@alvh.no-ip.org> <9837222c0908010828x7182494av3fd5909b64f4b2ad@mail.gmail.com> <9837222c0908030656m6ed69a26gc90a6c94b41a4c47@mail.gmail.com> <9837222c0908030716r416d789ewef3f77c65b39d916@mail.gmail.com> Date: Mon, 3 Aug 2009 19:50:26 +0530 Message-ID: Subject: Re: BUG #4958: Stats collector hung on WaitForMultipleObjectsEx while attempting to recv a datagram From: Nikhil Sontakke To: Magnus Hagander Cc: Alvaro Herrera , Luke Koops , pgsql-bugs@postgresql.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-2.599 tagged_above=-10 required=5 tests=BAYES_00=-2.599 X-Spam-Level: X-Archive-Number: 200908/8 X-Sequence-Number: 23835 Hi, >>>> >>>> And this fact should lend credence to Alvaro's (as well as mine) >>>> suspicions that it seems to be a Windows kernel issue. >>>> >>>> As a consequence, Magnus I was wondering if having a loop similar to >>>> the WRITE handling of waiting for a fixed timeout in a loop (rather >>>> than an INFINITE call to WaitForMultipleObjectsEx) inside the >>>> pgwin32_waitforsinglesocket() function will help for the READ case >>>> too? I believe Teogor Sigaev had raised a similar concern a while back >>>> about it: >>>> >>>> http://www.nabble.com/-GENERAL--Stats-collector-frozen--td8569977i20.html >>> >>> Maybe. I'm unsure if it's enough to just try another >>> WaitForSingleObjectEx() on it, or if we need to actually issue a >>> WSARecv() on it as well. Maybe it would be enough to just change the >>> INIFINTE on line 318 of socket.c to a fixed value. That will loop down >>> to WSARecv() which should exit with WSAEWOULDBLOCK which will cause us >>> to do a short sleep and come back. But we'd have to change the limit >>> of 5 somehow then, since in theory we should wait forever. Maybe that >>> outer loop should just be a for(;;), what do you think? >>> >> >> Yes, line 318 seems to be a much better location to me. If Windows and >> it's socket logic behaves properly most of the times :), most of the >> calls should come out within the first few tries, so changing 5 to an >> infinite loop shouldn't hurt those normal use cases in theory. >> >> OTOH, I was wondering what if we kill the stats collector and on a >> restart the socket communication resumes properly. Would that >> conclusively mean that it is a flaw in our code? > > No, if we kill the stats collector that will destroy all sockets, and > when the new one starts all the sockets it operates on are fresh and > new. So it doesn't show that the flaw is in our code - but it also > doesn't show that it's in the kernel or runtime libraries. > AFAICS in the code, the inherited pgStatSock socket FD remains the same across the restart of the stats collector process... Regards, Nikhils -- http://www.enterprisedb.com