Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id EA75A9FB35B for ; Thu, 28 Sep 2006 17:14:05 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 29176-07 for ; Thu, 28 Sep 2006 17:13:59 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey- Received: from svr4.postgresql.org (svr4.postgresql.org [66.98.251.159]) by postgresql.org (Postfix) with ESMTP id 634259FB360 for ; Thu, 28 Sep 2006 17:13:59 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.3 Received: from courils.dreamgnu.com (hosting.dreamgnu.com [213.131.245.234]) by svr4.postgresql.org (Postfix) with ESMTP id 079B15AF031 for ; Thu, 28 Sep 2006 19:41:43 +0000 (GMT) Received: from localhost (localhost.localdomain [127.0.0.1]) by courils.dreamgnu.com (Postfix) with ESMTP id 6873A8000A9 for ; Thu, 28 Sep 2006 21:41:41 +0200 (CEST) Received: from courils.dreamgnu.com ([127.0.0.1]) by localhost (courils [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 03388-01 for ; Thu, 28 Sep 2006 21:41:39 +0200 (CEST) Received: from [192.168.2.20] (amd64.dreamgnu.home [192.168.2.20]) by courils.dreamgnu.com (Postfix) with ESMTP id 26262800091 for ; Thu, 28 Sep 2006 21:41:39 +0200 (CEST) Message-ID: <451C2572.20800@dreamgnu.com> Date: Thu, 28 Sep 2006 21:41:38 +0200 From: Cedric Boudin Reply-To: cedric@dreamgnu.com User-Agent: Debian Thunderbird 1.0.2 (X11/20060724) X-Accept-Language: en-us, en MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: archive wal's failure and load increase. X-Enigmail-Version: 0.91.0.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at hosting.dreamgnu.com X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests= X-Spam-Level: X-Archive-Number: 200609/403 X-Sequence-Number: 21089 Honorable members of the list, I would like to share with you a side effect that I discovered today on our postgresql 8.1 server. We ve been running this instance with PITR for now 2 months without any problems. The wal's are copied to a remote machine with the pg_archive_command and locally to some other directory. For some independant reasons we made the remote machine unreachable for some hours. The pg_archive_command returned as expected a failure value. Now to what puzzles me: the load on the box that normally is kept between 0.7 and 1.5 did suddenly rise to 4.5 -5.5 and the processes responsiveness got bad. The dir pg_xlog has plenty of space to keep several day of wal's. there was no unfinished backup's or whatever that could have apparently slowed the machine that much. So the question is: is there a correlation between not getting the wal's archived and this "massive" load growth? In my understanding, as the pgl engine has nothing more to do with the filled up log except just to make sure it's archived correctly ther should not be any significant load increase for this reason. Looking at the logs the engine tried approx. every 3 minutes to archive the wal's. Is this behaviour expected, If it is then is it reasonnable to burden the engine that is already in a inexpected situation with some IMHO unecessary load increase. your thougths are welcome Cedric