Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1eA743-0006xV-NS for pgsql-admin@arkaria.postgresql.org; Thu, 02 Nov 2017 04:25:12 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1eA743-0000zQ-AE for pgsql-admin@arkaria.postgresql.org; Thu, 02 Nov 2017 04:25:11 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1eA72D-0003Nd-FG for pgsql-admin@postgresql.org; Thu, 02 Nov 2017 04:23:17 +0000 Received: from cat-porwal-prod-mail1.catalyst.net.nz ([2404:130:4080::4]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1eA729-0004mu-Lo for pgsql-admin@postgresql.org; Thu, 02 Nov 2017 04:23:15 +0000 Received: from localhost (localhost [127.0.0.1]) by cat-porwal-prod-mail1.catalyst.net.nz (Postfix) with ESMTP id E079D80FCD; Thu, 2 Nov 2017 17:23:08 +1300 (NZDT) X-Virus-Scanned: Debian amavisd-new at cat-porwal-prod-mail1.servers.catalyst.net.nz Received: from cat-porwal-prod-mail1.catalyst.net.nz ([127.0.0.1]) by localhost (cat-porwal-prod-mail1.servers.catalyst.net.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xA96d9KI-zfk; Thu, 2 Nov 2017 17:23:07 +1300 (NZDT) Received: from [IPv6:2406:e001:c36:1:2cec:517b:23ee:4dfc] (unknown [IPv6:2406:e001:c36:1:2cec:517b:23ee:4dfc]) (Authenticated sender: mark.kirkwood@catalyst.net.nz) by cat-porwal-prod-mail1.catalyst.net.nz (Postfix) with ESMTPSA id BAA5880FC7; Thu, 2 Nov 2017 17:23:07 +1300 (NZDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=catalyst.net.nz; s=catalyst; t=1509596587; bh=OrPhEzqgZ9pLs3A2GUcAGojtxs27xk4zY4G1agku6do=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=QlkCOzsFyorb12w3QQ5UuWmrtI2jHBtxNqi6mMUFOA9lRAX0vl9LJOoRYxqYgNINT ZKzenLBirBAuEH0xyNThwDrzBajrcdWxT8/GtX8GLn6eOrkD/FEC+JSt5FoS9YgYzI Uvi8xhpr1oFGOpTWfv0JdgJOVHhfPb9NkO1N4zys= Subject: Re: Bad recovery: no pg_xlog/RECOVERYXLOG To: Stephen Frost Cc: pgsql-admin@postgresql.org References: <1070071508952614@web46j.yandex.ru> <20171030154706.GE4628@tamriel.snowman.net> <7966ee9e-2241-eced-4639-e32c157b915a@catalyst.net.nz> <20171031114756.GP4628@tamriel.snowman.net> <2e3453d3-da6f-88af-05ec-7530e7f60547@catalyst.net.nz> <20171101122847.GS4628@tamriel.snowman.net> <4efa2769-78c4-7bf0-5c33-0cf2d942ce74@catalyst.net.nz> <20171101221807.GW4628@tamriel.snowman.net> From: Mark Kirkwood Message-ID: Date: Thu, 2 Nov 2017 17:23:07 +1300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <20171101221807.GW4628@tamriel.snowman.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org On 02/11/17 11:18, Stephen Frost wrote: > Not having > a way to reliably sync the WAL files copied by archive command to disk, > in particular, really is an issue, it's not some feature, it's a > requirement of a functional PG backup system. The other requirement for > a functional PG backup system is a check to verify that all of the WAL > for a given backup has been archived safely to disk, otherwise the > backup is incomplete and can't be used. > > Funnily enough, the original poster's scripts were attempting to address (at least some) of this: he was sending stuff to swift, so if he got a ok return code then it is *there* - that being the whole point of a distributed, fault tolerant object store (I do swift support BTW). I wonder if you are seeing this discussion in the light of folk doing backups to unreliable storage locations (e.g: the same server, NFS etc etc), then sure I completely agree with what you are saying (these issue impact backup designs no matter what tool is used to write them). Best wishes Mark -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin