Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sjiEZ-003EhV-TO for pgsql-general@arkaria.postgresql.org; Thu, 29 Aug 2024 16:42:55 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sjiEW-004ZGB-T2 for pgsql-general@arkaria.postgresql.org; Thu, 29 Aug 2024 16:42:53 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sjiEW-004ZG3-Hx for pgsql-general@lists.postgresql.org; Thu, 29 Aug 2024 16:42:53 +0000 Received: from mail-yb1-xb2f.google.com ([2607:f8b0:4864:20::b2f]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sjiET-0026oG-Gz for pgsql-general@postgresql.org; Thu, 29 Aug 2024 16:42:52 +0000 Received: by mail-yb1-xb2f.google.com with SMTP id 3f1490d57ef6-e116a5c3922so869889276.1 for ; Thu, 29 Aug 2024 09:42:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1724949769; x=1725554569; darn=postgresql.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=LDqVJc24z33VOdFktFnuZGKg/KH/d/TeZfopMHjr4bo=; b=BQP6HVnDt35IA1b6/qcwRYP6AhcLYUOlZ96qx8QBEDW80x7DQXsbYsWWs5CN+H00Gx LJEDIcNgJz84RpaZuAqNTADbMvpTuz8AdTF1b7qdgPRYZA/88cX6Fmf9xGetuLHUnReB Q1ElUC7odIUvE6e54uCtVtW+PS7Nw+nOrVL6l5ocvzSFhUKRP0kK77wUIgfIPa/+Mk9z hekBvdRiN+rWoXTnh85L5aLxQqI80saU3z8ExAKalkOYAQItyggIQ6WByurgslOiitWl Nbv3G7+xb7UVuGLliGo/BIUJitLf4ZLFv+ALDm/4/8kTcmaMNc7QyCnrPEgZfhk5UU25 T3Ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1724949769; x=1725554569; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=LDqVJc24z33VOdFktFnuZGKg/KH/d/TeZfopMHjr4bo=; b=ogCppze5YmkuHCKlrYrWi0cthKUHh0KaZESFhOMp3deNnZSeTv4biXxQ3/CkTnNi92 rT9ZyxWDEi4faKAR9b9AqqHli/9PV1iJd2VRIopYwnhu+qcIUojfDhXn7nzC3390b5Lw n70SKzCQyg7BYyxw2lyVnC9c/ODNRb2ul3/9wWuLysVEhDOyrhRYbYUOvmcboNXsO2WL 4LRVFF2urst1JGQXuypzpTfEd4bt7rVGgGsJqpCN67y0S8ttlIzTmYKi1JfAGVjgD6a2 imyG4VOlrpsIm+xTpIS16+hqSWBSnnUSFqHNv5bKmrJ4Lu2mnzuA+TOA4HvuOR/Vw4aq 9qpg== X-Gm-Message-State: AOJu0YwtIdZ8QezrTBxRUAn9rLdF2UNYORnKrs7lnlT4fFTiJ5s79UPb rgS0hn+k4LFM5suWGe6PcC2ZfeczX7pzldzg6tVCm0WRg6c0mgej8cPp5fKMY4QNnZBxbG+qr1S EY4x9xYtVROb+jYxioSnI4riTmhyYIFls X-Google-Smtp-Source: AGHT+IEutA5KTnRkHG2n44ch8xuAkIGxJXp/YRMhtf80rZw0KnRlIm6Iz6N4b6R0wu2mBDAYuc4ckWEH4trmv3rfxSA= X-Received: by 2002:a05:6902:1684:b0:e11:7ecc:3b0b with SMTP id 3f1490d57ef6-e1a5ab6b1f5mr3999752276.14.1724949768895; Thu, 29 Aug 2024 09:42:48 -0700 (PDT) MIME-Version: 1.0 From: KK CHN Date: Thu, 29 Aug 2024 22:12:37 +0530 Message-ID: Subject: PgBackRest Ideal N/W need to provisioned ? To: pgsql-general Content-Type: multipart/alternative; boundary="0000000000003b07690620d52ad3" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --0000000000003b07690620d52ad3 Content-Type: text/plain; charset="UTF-8" List, I am doing a full backup using PgBackRest from a production server to Reposerver. My connection is IPSec VPN over ILL ( 8 Mbps link) between the Production DB Server and the remote RepoServer. I understood the bottleneck of 8 Mbps between servers. (Server NICs 10Gbps and switch 10G) The current size of the production DB data dir 500GB can grow upto 1 TB to 2 TBs during a time span of one year from today. Query : I have started the backup command and it is running (may go for hours and days as link speed is minimal, right now it is achieved only 25GB/500 GB copied from 10:55 Hrs to 22:00 Hrs) . What should be the ideal connectivity without over provisioning the bandwidth, but doing a full backup must finish within acceptable time duration. I mean the connectivity btw. production server to Repo server i) ILL with SSL VPN btw servers ii) OR MPLS between servers ? iii) what should be the ideal bandwidth required considering the data dir size mentioned above to do a reasonable backup (Full). within a reasonable time window iv) without over provisioning and underprovisioning what should be the ideal connectivity and its bandwidth requirement to avoid network errors and intermittent disconnection of links if any? v ) Need to perform at least one full backup in a week Any suggestions much appreciated Thank you , Krishane --0000000000003b07690620d52ad3 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
List,

I am doing a full backup= =C2=A0 using PgBackRest from a production server=C2=A0to Reposerver.=C2=A0= =C2=A0

My connection is=C2=A0 IPSec VPN over ILL= =C2=A0 ( 8 Mbps link) between the=C2=A0 =C2=A0Production DB Server and=C2= =A0 the remote RepoServer.

I understood the=C2=A0 = bottleneck of 8 Mbps between servers. (Server NICs 10Gbps and=C2=A0switch 1= 0G)

The current size of the production=C2=A0DB= =C2=A0 =C2=A0data dir=C2=A0 500GB=C2=A0 can grow upto 1 TB=C2=A0 to 2 TBs d= uring a time span of one year from today.

Query : = I have started the=C2=A0 backup command=C2=A0 and it is running (may go for= hours and days as link speed is minimal, right now it is achieved only 25G= B/500 GB copied from 10:55 Hrs to=C2=A0 22:00 Hrs) .


What should be the ideal connectivity without over provis= ioning the bandwidth, but doing a full backup must finish within acceptable= time duration.

I mean the connectivity btw. produ= ction server to Repo server
=C2=A0i) ILL with SSL VPN btw=C2=A0 s= ervers=C2=A0
ii) OR MPLS between=C2=A0 servers ?
iii) w= hat should be the ideal bandwidth=C2=A0 required considering the data dir s= ize mentioned above to do a reasonable backup (Full). within a=C2=A0 reason= able time window
iv)=C2=A0 without over provisioning=C2=A0and und= erprovisioning what should be the ideal connectivity and its bandwidth=C2= =A0requirement to avoid network errors and intermittent=C2=A0 disconnection= of links=C2=A0 if any?

v ) Need to perform at lea= st one full backup in a week=C2=A0

Any suggestions= much appreciated

Thank you ,
Krishane
--0000000000003b07690620d52ad3--