Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1p0SKZ-0002IV-KT for pgsql-general@arkaria.postgresql.org; Wed, 30 Nov 2022 19:01:15 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1p0SKY-0006Hb-9K for pgsql-general@arkaria.postgresql.org; Wed, 30 Nov 2022 19:01:14 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1p0SKX-0006HS-Sr for pgsql-general@lists.postgresql.org; Wed, 30 Nov 2022 19:01:13 +0000 Received: from mail-qt1-x82c.google.com ([2607:f8b0:4864:20::82c]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1p0SKV-0002tE-Ba for pgsql-general@lists.postgresql.org; Wed, 30 Nov 2022 19:01:13 +0000 Received: by mail-qt1-x82c.google.com with SMTP id r19so1743250qtx.6 for ; Wed, 30 Nov 2022 11:01:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:from:content-language:references:to:subject:user-agent :mime-version:date:message-id:from:to:cc:subject:date:message-id :reply-to; bh=1GkWqdtdDUgPYCFvWV0KdXfLY7jOtqh9VVsTMVvSp4Y=; b=RQS8w11G7k7jB99z8bEL+E4yqh6+Iy2plADeQvgdpcJHtQSWI+9KN8N7ZLYllK7d92 DhPeZxvErZsVAqmXFZkoSiQs4bBQ1h0BVtqVt2RPEp1l4V/AuJcH9L2hwgkxr3TUy681 SBDdeggwwk1cC1KKuSUx3yszVsJC9shNiCsKHS6yV9vKYnZODKHpm+nIK5Gq5FeKmM0C Qi27Y564lnnBaJLBZ1zm2iW8OKUeG14D45XAQqD0HW07rF+ye8pf91EEKOtB+HFR2j6q T/lVx8Ynyxam9/SZ0nVGI3q8Q0QdcJ3miBvSGVs0Kw3XwyOUZKFs+Lzv/G0T3jK72kGr 93YA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:from:content-language:references:to:subject:user-agent :mime-version:date:message-id:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=1GkWqdtdDUgPYCFvWV0KdXfLY7jOtqh9VVsTMVvSp4Y=; b=ggwEDXbUhuG373TGoRPqcdl/h29nOgeDIxFtxXQ8pjBIse0Qrj39EErr2hNLqAMGZm WaiMqNWXkSAxbSao/vnHBO2a8UyZqPVYXsgdsAxAZN5n78Z1cuNXzdyZ/hQdoQn9WyBR okgcVahMTIitQJMKh6V+fNmGvJTqDmp2V3gTLN5Inl6c4JJoV9cp0+u/rMSObBCiDWYH w8BLiBf0oTnqOehfmNJGjoH3R17tfrM4wWuIwBYdoh/qvNF3ItDIY6Ep/42oU7iiRhqK BLmJKWSAzCkpAGzTKoFhf1Gfo03KULo8t6uorcXaJvzgiuOMTxI3wz2r+kF0AAPpbCv4 2GYA== X-Gm-Message-State: ANoB5pl3gI0W791M6NN6gdN0tRoBPAMTvRASu67Ng5y/Yoh+LJr2kY9+ be1LLCSEyTw2D8r703eFYonMo7RgaSOetA== X-Google-Smtp-Source: AA0mqf64e5DaCBRJHhUurmxWZLN0zUELUvtnh9ROo73VYagsLBujdDr3hEUeOW+G8PQt8NS5PwwX9Q== X-Received: by 2002:a05:622a:420b:b0:3a4:fb31:db9c with SMTP id cp11-20020a05622a420b00b003a4fb31db9cmr57413163qtb.637.1669834868970; Wed, 30 Nov 2022 11:01:08 -0800 (PST) Received: from [192.168.2.100] (pool-72-79-30-4.nwrknj.east.verizon.net. [72.79.30.4]) by smtp.gmail.com with ESMTPSA id x13-20020ac86b4d000000b0035badb499c7sm1274209qts.21.2022.11.30.11.01.08 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 30 Nov 2022 11:01:08 -0800 (PST) Content-Type: multipart/alternative; boundary="------------vdnjk8KOoz4t4Mw2Jl8dJq5o" Message-ID: <9d50f118-a3dd-565a-41bd-d3056b9b90d6@gmail.com> Date: Wed, 30 Nov 2022 14:01:08 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.5.0 Subject: Re: postgres large database backup To: pgsql-general@lists.postgresql.org References: Content-Language: en-US From: Mladen Gogala In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is a multi-part message in MIME format. --------------vdnjk8KOoz4t4Mw2Jl8dJq5o Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 11/30/22 10:40, Atul Kumar wrote: > Hi, > > I have a 10TB database running on postgres 11 version running on > centos 7 "on premises", I need to schedule the backup of this database > in a faster way. > > The scheduled backup will be used for PITR purposes. > > So please let me know how I should do it in a quicker backup for my > 10TB database ? Is there any tool to take backups and subsequently > incremental backups in a faster way and restore it for PITR in a > faster way when required. > > What should be the exact approach for scheduling such backups so that > it can be restored in a faster way ? > Well, that depends on your configuration details. Is your DB located on a SAN device or JBOD? If it's SAN, than it can do snapshots. All enterprise backup utilities like NetBackup, TSM, Avamar or Commvault support snapshots. They all can do full and incremental backups and they can also do PITR. Your database is an enterprise sized database and needs an enterprise level tool. If you want a freebie, pgbackrest is the best thing no money can buy. Pgbackrest supports parallelism, full and incremental backups. -- Mladen Gogala Database Consultant Tel: (347) 321-1217 https://dbwhisperer.wordpress.com --------------vdnjk8KOoz4t4Mw2Jl8dJq5o Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 11/30/22 10:40, Atul Kumar wrote:
Hi, 

I have a 10TB database running on postgres 11 version running on centos 7 "on premises", I need to schedule the backup of this database in a faster way.

The scheduled backup will be used for PITR purposes.

So please let me know how I should do it in a quicker backup for my 10TB database ? Is there any tool to take backups and subsequently incremental backups in a faster way and restore it for PITR in a faster way when required.

What should be the exact approach for scheduling such backups so that it can be restored in a faster way ?

Well, that depends on your configuration details. Is your DB located on a SAN device or JBOD? If it's SAN, than it can do snapshots. All enterprise backup utilities like NetBackup, TSM, Avamar or Commvault support snapshots. They all can do full and incremental backups and they can also do PITR. Your database is an enterprise sized database and needs an enterprise level tool. If you want a freebie, pgbackrest is the best thing no money can buy. Pgbackrest supports parallelism, full and incremental backups.


-- 
Mladen Gogala
Database Consultant
Tel: (347) 321-1217
https://dbwhisperer.wordpress.com
--------------vdnjk8KOoz4t4Mw2Jl8dJq5o--