Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e9oYx-0001Fv-D8 for pgsql-admin@arkaria.postgresql.org; Wed, 01 Nov 2017 08:39:52 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1e9oYv-0007l7-RD for pgsql-admin@arkaria.postgresql.org; Wed, 01 Nov 2017 08:39:49 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1e9oX8-0004NA-BT for pgsql-admin@postgresql.org; Wed, 01 Nov 2017 08:37:58 +0000 Received: from cat-porwal-prod-mail1.catalyst.net.nz ([2404:130:4080::4]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1e9oX2-0004tS-2q for pgsql-admin@postgresql.org; Wed, 01 Nov 2017 08:37:56 +0000 Received: from localhost (localhost [127.0.0.1]) by cat-porwal-prod-mail1.catalyst.net.nz (Postfix) with ESMTP id C698480C72; Wed, 1 Nov 2017 21:37:44 +1300 (NZDT) X-Virus-Scanned: Debian amavisd-new at cat-porwal-prod-mail1.servers.catalyst.net.nz Received: from cat-porwal-prod-mail1.catalyst.net.nz ([127.0.0.1]) by localhost (cat-porwal-prod-mail1.servers.catalyst.net.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tsKEkLXfey4v; Wed, 1 Nov 2017 21:37:43 +1300 (NZDT) Received: from [IPv6:2406:e001:c36:1:7c6a:20e0:2511:86e5] (unknown [IPv6:2406:e001:c36:1:7c6a:20e0:2511:86e5]) (Authenticated sender: mark.kirkwood@catalyst.net.nz) by cat-porwal-prod-mail1.catalyst.net.nz (Postfix) with ESMTPSA id 22B8780B91; Wed, 1 Nov 2017 21:37:43 +1300 (NZDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=catalyst.net.nz; s=catalyst; t=1509525463; bh=ROOcC7vCVi9tH2Za+GRCpkQpRrZaIpmrhWHiYFljwrQ=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=Ajtl1gHOmTlbNJysuK/tfD8gA1lNNlEBYV3nFH6Um4BbiCPDJIwmeBe42ZJOEP8Tx m31w9CGbcFsRtT8o0W/RL0/3VpDsADqgLsSQeYFLu8fivNOmax6DmlMKO2ZKpAzjXZ 18q2aTu1N38ei4p7Bx43U/TggmQ1uRDUbq9aX2DQ= Subject: Re: Bad recovery: no pg_xlog/RECOVERYXLOG To: Stephen Frost Cc: pgsql-admin@postgresql.org References: <1070071508952614@web46j.yandex.ru> <20171030154706.GE4628@tamriel.snowman.net> <7966ee9e-2241-eced-4639-e32c157b915a@catalyst.net.nz> <20171031114756.GP4628@tamriel.snowman.net> From: Mark Kirkwood Message-ID: <2e3453d3-da6f-88af-05ec-7530e7f60547@catalyst.net.nz> Date: Wed, 1 Nov 2017 21:37:42 +1300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <20171031114756.GP4628@tamriel.snowman.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org On 01/11/17 00:47, Stephen Frost wrote: > Mark, > > * Mark Kirkwood (mark.kirkwood@catalyst.net.nz) wrote: >> On 31/10/17 04:47, Stephen Frost wrote: >>> * Marcin Koziej (marcin@cahoots.pl) wrote: >>>> Now it's fixed, but if anyone needs I'm attaching all scripts to 1) >>>> backup and restore wal's and 2) backup and restore base backup from >>>> OpenStack SWIFT >>> Interesting, but these scripts seem to be seriously lacking in error >>> checking (what happens if the copy to swift fails..? or pg_basebackup >>> fails?) and it's unclear how you can be sure that the WAL file has been >>> sync'd to disk which is important or you might end up having holes in >>> your WAL stream if the swift system fails. There's also no checking to >>> make sure that the WAL needed for a given pg_basebackup ever actually >>> made it to the swift system, which is required to ensure you have a >>> consistent backup. >>> >>> Generally speaking, these kinds of scripts really aren't a good choice >>> for doing backups of PG. I'd strongly suggest you look at one of the >>> existing tools which are developed specifically for doing backups of PG >>> and are well tested, supported, and maintained. If you'd like support >>> for a new storage system, I know that at least pgBackRest's storage >>> layer is pluggable and adding a new storage option is pretty straight >>> forward. >> I'm not convinced that his approach is bad. > I was the same way for a long time, thinking that shell scripts could > reasonably be used with certain caveats, but the devil really is in the > details and it's far too easy to miss things in shell scripts (such as > not checking return codes, or not doing so properly, or various other > issues). Also, you didn't address things like verifying that you > actually have all the WAL needed for a valid backup, and how to handle > retention? > >> The script checks the result of the 'swift upload' for the base >> backup, it is the wal backup one that does not explicitly check the >> 'swift upload' result (this should really be added). To be fair, >> anything wrong with the swift system will likely be discovered >> immediately beforehand where he does a 'swift stat'! > Things could certainly break between those two calls to swift, in a > variety of ways. > >> I'd guess his original problem was an improperly setup >> recovery.conf, rather than the overall design. > I agree that the original issue is unlikely to be related to these > scripts. That doesn't mean that using them is a good idea. > > Exactly - ,the original issue is unlikely to be related to these scripts! While I agree that the scripts concerned would benefit from some development/qa etc, I'm really disagreeing with your point that folk 'should not do this'. I would like to say that folk 'should do this' - but try to do it well - and we should help them (isn't that idea kinda tied up with the whole point of these lists)? I'm not keen on us being seen to stifle development just because we know of another existing product that *might* be better. To me that seems like a slippery slope that gets us endorsing only certain vendors solutions (whether they be open source or not). I'm not a fan of that at all. regards Mark -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin