Content-Type: multipart/alternative;
 boundary="------------HE8rj37MDpJyg7qzGK1ZdiBj"
Message-ID: <1b297f2c-aef1-084c-b10a-f36154fdd636@gmail.com>
Date: Thu, 10 Feb 2022 11:45:25 -0500
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101
 Thunderbird/91.5.0
Subject: Re: PG_Base Backup take 8 to 9Hrs
Content-Language: en-US
To: MichaelDBA <MichaelDBA@sqlexec.com>
Cc: pgsql-admin@lists.postgresql.org
References: 
 <KL1PR0601MB44331141771E87939CAB3B91F02D9@KL1PR0601MB4433.apcprd06.prod.outlook.com>
 <91f9d08c-fb4b-5847-4663-e96994c1f460@gmail.com>
 <627d342b-6054-bb08-86d0-15c0a8e58887@sqlexec.com>
From: Mladen Gogala <gogala.mladen@gmail.com>
In-Reply-To: <627d342b-6054-bb08-86d0-15c0a8e58887@sqlexec.com>
Archived-At: 
 <https://www.postgresql.org/message-id/1b297f2c-aef1-084c-b10a-f36154fdd636%40gmail.com>
Precedence: bulk

This is a multi-part message in MIME format.
--------------HE8rj37MDpJyg7qzGK1ZdiBj
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

Please don't top-post.

On 2/10/22 09:31, MichaelDBA wrote:
> Please use a third party backup solution that provides faster and more 
> flexible backup alternatives than the built in, pg_basebackup(), which 
> is not usefult for large databases.
> pgbackrest (full, differential, and incremental)
> barman (full and incremental)
>
> Regards,
> Michael Vitale
>
> Mladen Gogala wrote on 2/9/2022 7:42 PM:
>> On 2/8/22 06:36, Ram Pratap Maurya wrote:
>>>
>>> We are using Postgres -11 version and current *PG DB size is 450 GB* .
>>>
>>> Archive log enable in Database and we are running Full *PG_Base 
>>> backup* and it will take 8 to 9 Hrs to complete the backup ,
>>>
>>> Please suggest  how to reduce the full DB backup time.
>>>
>> Use storage snapshots, faster disks, faster Ethernet adapters and 
>> backup software that supports deduplication. You are asking the list 
>> to architect your backup solution. For that, some more information is 
>> needed: what kind of machine are you using, what OS, how much memory, 
>> what kind of storage is your cluster running on, what kind of storage 
>> are you backing it up to, how is the backup storage connected (FC/AL, 
>> Ethernet, local SATA drives), is there any degree of parallelism and 
>> things of that nature. In the absence of that information, I can only 
>> recommend attempting with the --run-faster switch to pg_basebackup. 
>> You may also try using the Force.
>>
>> -- 
>> Mladen Gogala
>> Database Consultant
>> Tel: (347) 321-1217
>> https://dbwhisperer.wordpress.com
>
I can wholeheartedly recommend Commvault backup suite. It can seamlessly 
utilize storage snapshot and has built in parallelism, deduplication and 
compression.

Regards

-- 
Mladen Gogala
Database Consultant
Tel: (347) 321-1217
https://dbwhisperer.wordpress.com

--------------HE8rj37MDpJyg7qzGK1ZdiBj
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <div class="moz-cite-prefix">Please don't top-post.</div>
    <div class="moz-cite-prefix"><br>
    </div>
    <div class="moz-cite-prefix">On 2/10/22 09:31, MichaelDBA wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:627d342b-6054-bb08-86d0-15c0a8e58887@sqlexec.com">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      Please use a third party backup solution that provides faster and
      more flexible backup alternatives than the built in,
      pg_basebackup(), which is not usefult for large databases.<br>
      pgbackrest (full, differential, and incremental)<br>
      barman (full and incremental)<br>
      <br>
      Regards,<br>
      Michael Vitale<br>
      <br>
      <span>Mladen Gogala wrote on 2/9/2022 7:42 PM:</span><br>
      <blockquote type="cite"
        cite="mid:91f9d08c-fb4b-5847-4663-e96994c1f460@gmail.com">
        <meta http-equiv="Content-Type" content="text/html;
          charset=UTF-8">
        <div class="moz-cite-prefix">On 2/8/22 06:36, Ram Pratap Maurya
          wrote:<br>
        </div>
        <blockquote type="cite"
cite="mid:KL1PR0601MB44331141771E87939CAB3B91F02D9@KL1PR0601MB4433.apcprd06.prod.outlook.com">
          <p class="MsoPlainText"><span style="color:#1F497D">We are
              using Postgres -11 version and current <b>PG DB size is
                450 GB</b> .<o:p></o:p></span></p>
          <p class="MsoPlainText"><span style="color:#1F497D">Archive
              log enable in Database and we are running Full <b>PG_Base
                backup</b> and it will take 8 to 9 Hrs to complete the
              backup ,<o:p></o:p></span></p>
          <p class="MsoPlainText"><span style="color:#1F497D">Please
              suggest  how to reduce the full DB backup time.</span></p>
        </blockquote>
        <p>Use storage snapshots, faster disks, faster Ethernet adapters
          and backup software that supports deduplication. You are
          asking the list to architect your backup solution. For that,
          some more information is needed: what kind of machine are you
          using, what OS, how much memory, what kind of storage is your
          cluster running on, what kind of storage are you backing it up
          to, how is the backup storage connected (FC/AL, Ethernet,
          local SATA drives), is there any degree of parallelism and
          things of that nature. In the absence of that information, I
          can only recommend attempting with the --run-faster switch to
          pg_basebackup. You may also try using the Force.<br>
        </p>
        <pre class="moz-signature" cols="72">-- 
Mladen Gogala
Database Consultant
Tel: (347) 321-1217
<a class="moz-txt-link-freetext" href="https://dbwhisperer.wordpress.com" moz-do-not-send="true">https://dbwhisperer.wordpress.com</a>
</pre>
      </blockquote>
      <br>
    </blockquote>
    <p>I can wholeheartedly recommend Commvault backup suite. It can
      seamlessly utilize storage snapshot and has built in parallelism,
      deduplication and compression.</p>
    <p>Regards<br>
    </p>
    <pre class="moz-signature" cols="72">-- 
Mladen Gogala
Database Consultant
Tel: (347) 321-1217
<a class="moz-txt-link-freetext" href="https://dbwhisperer.wordpress.com">https://dbwhisperer.wordpress.com</a>
</pre>
  </body>
</html>

--------------HE8rj37MDpJyg7qzGK1ZdiBj--