X-Original-To: pgsql-admin-postgresql.org@localhost.postgresql.org Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id 9774D9FA1B0 for ; Mon, 15 May 2006 19:46:58 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 90407-06 for ; Mon, 15 May 2006 19:46:47 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey- Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.171]) by postgresql.org (Postfix) with ESMTP id 0BEE89F9C18 for ; Mon, 15 May 2006 19:46:47 -0300 (ADT) Received: from [195.112.19.37] (helo=[192.168.0.7]) by mrelayeu.kundenserver.de (node=mrelayeu6) with ESMTP (Nemesis), id 0ML29c-1Fflpp3zJs-0000ZS; Tue, 16 May 2006 00:46:42 +0200 Subject: Re: does wal archiving block the current client connection? From: Simon Riggs To: Jeff Frost Cc: pgsql-admin@postgresql.org In-Reply-To: References: <1147728181.5074.73.camel@localhost.localdomain> Content-Type: text/plain Date: Mon, 15 May 2006 23:46:32 +0100 Message-Id: <1147733193.5074.87.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.6.1 (2.6.1-1.fc5.2) Content-Transfer-Encoding: 7bit X-Provags-ID: kundenserver.de abuse@kundenserver.de login:726643fe08f41a451f0fe7fa43bce239 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200605/204 X-Sequence-Number: 21736 On Mon, 2006-05-15 at 14:29 -0700, Jeff Frost wrote: > On Mon, 15 May 2006, Simon Riggs wrote: > > > On Mon, 2006-05-15 at 09:28 -0700, Jeff Frost wrote: > >> I've run into a problem with a PITR setup at a client. The problem is that > >> whenever the CIFS NAS device that we're mounting at /mnt/pgbackup has > >> problems > > > > What kind of problems? > > It becomes unwritable for whatever reason CIFS shares become unwritable. It's > a windows 2003 NAS device and a reboot solves the problem, but it leaves no > event logs on the windows side of things, so difficult to determine the root > cause. You should be able to re-create this problem without the database being involved. Just set up a driver program over the top of the archive script so it flies in a tighter loop than the archiver would make it. If you still get the Windows NAS error... well, I'll leave that to you. > >> , it seems that the current client connection gets blocked and this > >> eventually builds up to a "sorry, too many clients already" error. Tell us more about what the blockage looks like. We may yet thank Windows for finding a bug, but I'm not sure yet. > > This sounds like the archiver keeps waking up and trying the command, > > but it fails, yet that request is causing a resource leak on the NAS. > > Eventually, archiver retrying the command eventually fails. Or am I > > misunderstanding your issues? > > that's possible. Does the archiver use a DB connection whenever it tries to > run archive_command? Not at all. > If so, then that's almost certainly the problem. I > suspect a faster timeout on the CIFS mount would fix the issue as well, but I > didn't see any such options in the mount.cifs manpage. > > > The archiver is designed around the thought that *attempting* to archive > > is a task that it can do indefinitely without a problem; its up to you > > to spot that the link is down. > > > > We can put something in to make the retry period elongate, but you'd > > need to put a reasonable case for how that would increase robustness. > > That all sounds perfectly reasonable. If the archiver is using up a > connection for each archive_command issued, then I suspect that's our problem, > as there were also lots of debug logs showing that the db was trying to > archive several WAL files at near the same time, likely pushing us over our > 100 connection limit. Oh, you mean database clients cannot connect. I thought you meant you were getting a CIFS client connection error from the archiver. That's wierd. > If the archiver does not use up a connection, then I > suppose I don't know what's actually going on unless postgres blocks the > commit of the transaction which triggered the archive_command until the > archive command finishes (or fails). I think you need to show the database log covering the period in error. Are you running out of disk space in the database directory? Can you check again that pg_xlog and pg_xlog/archive_status is definitely not on the NAS? -- Simon Riggs EnterpriseDB http://www.enterprisedb.com