Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1YNp2g-0004ww-1X for pgsql-admin@arkaria.postgresql.org; Tue, 17 Feb 2015 20:46:50 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1YNp2e-0007hk-NC for pgsql-admin@arkaria.postgresql.org; Tue, 17 Feb 2015 20:46:48 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1YNp2d-0007he-Pb for pgsql-admin@postgresql.org; Tue, 17 Feb 2015 20:46:47 +0000 Received: from resqmta-ch2-03v.sys.comcast.net ([2001:558:fe21:29:69:252:207:35]) by magus.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1YNp2Y-0002o9-QH for pgsql-admin@postgresql.org; Tue, 17 Feb 2015 20:46:46 +0000 Received: from resomta-ch2-17v.sys.comcast.net ([69.252.207.113]) by resqmta-ch2-03v.sys.comcast.net with comcast id tYm91p00A2TL4Rh01Yme0v; Tue, 17 Feb 2015 20:46:38 +0000 Received: from jerry.enova.com ([12.30.159.20]) by resomta-ch2-17v.sys.comcast.net with comcast id tYmS1p0040ShjPw01YmUAK; Tue, 17 Feb 2015 20:46:36 +0000 Received: by jerry.enova.com (Postfix, from userid 1001) id D40167401ED; Tue, 17 Feb 2015 14:46:25 -0600 (CST) From: Jerry Sievers To: girish R G peetle Cc: Kevin Grittner , pgsql-admin Subject: Re: PostgreSQL File System Based Backup Restartability References: <490542817.5380493.1424190883552.JavaMail.yahoo@mail.yahoo.com> Date: Tue, 17 Feb 2015 14:46:25 -0600 In-Reply-To: (girish R. G. peetle's message of "Tue, 17 Feb 2015 22:30:36 +0530") Message-ID: <86vbj04672.fsf@jerry.enova.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1424205998; bh=REVGjc5t81Yc/+iEv4vmKu1le0uyh4wt9VzGAmP8LUQ=; h=Received:Received:Received:From:To:Subject:Date:Message-ID: MIME-Version:Content-Type; b=jl9b1ZilZDWZNqtKt4I50hUMGt2wIl9Gu7IcTBugwFa6PDnVIwED1+BdA1wNsdcIo YglIzFn0rIkcrSTEHoJ11hdK9OM5XF4HU3yJvUdXIg9BDi2VByVxJNs4WLjsJNd2GB tl3rS8qERhe0Qp1lcFFzi2Y3qDPJG1Cuko0IGTs+fpb4ga7DG217QwO3TDS2CeAGv2 youRxTpuuWwrPR/f2HpIqdE3tuntACZky99ulHOZlkniygTr5VexP5pdlV7CQLp5GY T3mBDsgzU1Xj8/2x9r7Dtb5cWO2N7uUiHMYdNQDkuwrPC4KZ4u51HXBk6orAhYThIg wEYgcgDGFhG2g== X-Pg-Spam-Score: -1.5 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org girish R G peetle writes: > Thanks Kevin. > > "Be careful that when you resume after such an interruption you do > not skip any files and that you complete or re-copy any files that > were partially copied before the problems." > > Here you mean, we should not skip any files that was already backed up before interruption ? >  I will have to backup entire content under DATA directory again ? False. Any file already copied and known copied thoroughly should not require copying again. The file under copy when the network drop occurred needs copying again and/or syncing if your copy program knows how to do that without moving all bits... and of course all missing files need copying also. HTH > Thanks > Girish > > On Tue, Feb 17, 2015 at 10:04 PM, Kevin Grittner wrote: > > girish R G peetle wrote: > > > Steps > > - Database size is 1 TB > > - I'll execute pg_start_backup('label'); > > - I will traverse through the DATA directory to get the list of > >   directories and files. > > - I will start moving the files to backup media. ( over network ) > > - When I'm half way (500GB done), network error happens. So > >   movement of files is halted. > > - Network issue is resolve after 30 minutes (In this time files > >   might have got deleted or added with creation/deletion of > >   database/tables ) > > - I'll resume moving the files to backup media from where it had > >   halted. > > - When movement of files is done, I'll execute pg_stop_backup() > > - I'll move all the transaction logs that got archived to backup > >   media. > > > > Is PostgreSQL server recovery to a consistent state possible with > > backup content obtained from above steps ? > > As long as you follow all the rules for what files to copy (and not > copy), you should have a good backup.  Some things to be careful > about that I've seen people get wrong with some frequency: > > - Be sure to exclude all files in and under the pg_xlog directory. >   The backup should contain the directory itself, and it is best to >   include its subdirectory, but copying the files can cause >   corruption. > - Exclude the postmaster.pid file. > - Be sure *not* to exclude the backup_label file.  Without this >   file, restoring from the backup may or may not have corruption, >   which may or may not be initially apparent. > > Be careful that when you resume after such an interruption you do > not skip any files and that you complete or re-copy any files that > were partially copied before the problems. > > -- > Kevin Grittner > EDB: http://www.enterprisedb.com > The Enterprise PostgreSQL Company > -- Jerry Sievers Postgres DBA/Development Consulting e: postgres.consulting@comcast.net p: 312.241.7800 -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin