Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1XbYca-0004B0-Lz for pgsql-admin@arkaria.postgresql.org; Tue, 07 Oct 2014 17:32:24 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1XbYca-0002mW-0e for pgsql-admin@arkaria.postgresql.org; Tue, 07 Oct 2014 17:32:24 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1XbYcZ-0002mO-00 for pgsql-admin@postgresql.org; Tue, 07 Oct 2014 17:32:23 +0000 Received: from mail-yh0-x232.google.com ([2607:f8b0:4002:c01::232]) by magus.postgresql.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1XbYcU-0001v0-QK for pgsql-admin@postgresql.org; Tue, 07 Oct 2014 17:32:21 +0000 Received: by mail-yh0-f50.google.com with SMTP id a41so3154479yho.23 for ; Tue, 07 Oct 2014 10:32:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=HnSUxQoZnLllrgx5EX6KuAzGZU8Y6h4LG4NtBXwqfrk=; b=j2NQtL7kvv9qRUPGkIImQlVqX3Q1YNb6VrtoDQRzu1vw6N6Vy4RIN5+tHNXFb+4o0d lD2XxfXnhvIVnc2L9KYYkKFdYvPTYL6oSUhrCDhbsDSijznamBkaZ6/CSitZr+LQJGx4 d3nf26Di6cYAp8PqKNHKW8s4ssNEA4JIZvzysVkCI91TPiY3kIfMbsf/uHtVrGzi81fb ALnqmYo6CFo5iQLyyz4Ce8mEgyw/LCRmgOecSH5is9np+Qo/kms6Ig7tlWJZiYZ98PYV bKjYrgC/l19/hgsnQgzVIMhprFI0sc0yCwgPCt3aCyUZ3ptoiNA+caO58MJ8R4X3Ya3Z xEFA== X-Received: by 10.236.93.39 with SMTP id k27mr7448807yhf.129.1412703136680; Tue, 07 Oct 2014 10:32:16 -0700 (PDT) Received: from [192.168.254.2] (h77.89.102.166.static.ip.windstream.net. [166.102.89.77]) by mx.google.com with ESMTPSA id v42sm8759184yhn.31.2014.10.07.10.32.15 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 07 Oct 2014 10:32:16 -0700 (PDT) Message-ID: <5434239E.50508@gmail.com> Date: Tue, 07 Oct 2014 13:32:14 -0400 From: John Scalia User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: "pgsql-admin@postgresql.org" Subject: Error messages in a hot standby server's logfiles Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -2.0 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org Hi all, My setup is: postgresql V9.3.3 running on a CentOS 6.5 (kernel 2.6.32-358.18.1.el6.x86_64) and I have 3 servers, one primary and two hot standbys. In our failover and loss of communications testing, I have seen a couple of issues that I'm hard to explain. For instance, we took one hot standby out of service by shutting down postgresql on it. Now, we're hot standby with log shipping as an insurance policy, so the WAL segments continued to be copied onto that out of service standby for a few minutes. On restart, I see: cp: cannot stat '/mnt/wallogs/archive/0000000C.history': No such file or directory cp: cannot stat '/mnt/wallogs/archive/0000000B0000001900000077': No such file or directory Later in the logfile, I see another failure for 000000B.history. In looking at the /mnt/wallogs/archive directory, those files aren't there, but as the primary never had an issue and continued to copy WAL segments to this directory, why was the standby looking for them? What triggered this? Also, in that directory, I often see files generated by the pg_basebackup command used to build the standby, files like "0000000B0000001900000000.00000028.backup" or generally files ending with .backup in their names. These never get removed automatically by the standby server. We have to manually remove them. So, I'm guessing they weren't necessary, so why did the primary copy them here using its archive_command? Why aren't they removed by some mechanism on the standby? -- Jay -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin