Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sFsHo-006wqj-SK for pgsql-general@arkaria.postgresql.org; Sat, 08 Jun 2024 09:22:57 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sFsGo-00GFLo-0J for pgsql-general@arkaria.postgresql.org; Sat, 08 Jun 2024 09:21:54 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sFsGn-00GFLg-Ep for pgsql-general@lists.postgresql.org; Sat, 08 Jun 2024 09:21:54 +0000 Received: from mail-vs1-xe33.google.com ([2607:f8b0:4864:20::e33]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sFsGh-000I2J-Bb for pgsql-general@lists.postgresql.org; Sat, 08 Jun 2024 09:21:52 +0000 Received: by mail-vs1-xe33.google.com with SMTP id ada2fe7eead31-48c458b9aa7so27538137.2 for ; Sat, 08 Jun 2024 02:21:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1717838506; x=1718443306; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=q/WwIcmAOg7zJTau8tbAj/Ita6GNloxjNv8F9PDCVPo=; b=EA+bf0pyFer6AqbMdXXPSG/zLTBFYh6kpeh+SGBS/hgfgw7i21ndgNDGgl6U7/5c3D 6/p1hyf0pRekCiT+qYBggWSDtXIWdJBMlCythNcXpC65Fc+3P6+WdP+37byV2YRd8Vdr GYMjcdOpmEOV6sCb+tKA8TpptfwFzACmnPT/Wurxg5VcV/coV56aaaL3D53tqg+7/U+l +CHn5oacZQFrr07Koz94JLo0GkrH8TLPu/BNQbinmJKdeKr0FbpzLDm+y+JZWc1T6FfW mMpY9M2K7UAqv3U5xWjCzKFCbckgWqcunI5ucu1npOeVfPeEDy1IgYe3p3GLBfPh59I2 HHfA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1717838506; x=1718443306; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=q/WwIcmAOg7zJTau8tbAj/Ita6GNloxjNv8F9PDCVPo=; b=X+x+zc/E1An0mnfcPOmnlwGjgQKBUDYTk4Icn7YJfGaT2RO6AK4ukymFnT2JJ42pa/ 6dx3i0lfxgQbX7K+Iifq7AQ2ikX4jLNlMttPa9WEKUEJkLgEPAzf4OcvQt0MSkp4+fE9 fj15XvwRz4K8k9f9v+0soOXnOlSd7DfEswhXoQNGAceBAPXak6YvqHV3KP7yK2d/amDO fVMfciF7nuK4P/ZERkqs+7PB/hdQGJD7bZfjNmwTeGVquDzz+ureEclklPy1Al+M1Ixv g8SjMNNt4Fbj9V/pZxbcZjvxEvCExndJOqNzifnztswjmpABQ6OJLSlnBkFs28/B/fBn 2ykA== X-Forwarded-Encrypted: i=1; AJvYcCWVh4iGRTycBBTy8lOBz4JQpTPwLscTYdaJFnTry8viynGr84ugeA6Wcrj/Ca7BUDurWxEliXMusgJhm0Daj/7ypLcDaK+potVVeZq82GkctzBY X-Gm-Message-State: AOJu0YxNaZI0zS2gJLn71c+quBkx3nYOChi0stOc4YFlgyWhfu/+LZPc jYsRcjjhKSclm95DHWMGOKtNYIGNUltviLIL8/hwnGry+ozcbZ6HV0pzbJBK3fxuRSXzG70Aa/C p3G2B1uCgEAtGMEnbbf3tG87NGDU= X-Google-Smtp-Source: AGHT+IG9n/iKtkbJlR0V/gL+z8mb/kn6vGEDzEcvLRvUDIoEstH5PJtbnJdV71NbMW4xVvWGZAaheqdkXoNOLanmsAE= X-Received: by 2002:a67:f314:0:b0:48c:3cf5:87a7 with SMTP id ada2fe7eead31-48c3cf58aa3mr1099807137.24.1717838504800; Sat, 08 Jun 2024 02:21:44 -0700 (PDT) MIME-Version: 1.0 References: <891bcfec74f7358ef0212caf6565a35153dd2941.camel@cybertec.at> <56ad97911d83f721dd872e8ee68cd77d50d3eef6.camel@cybertec.at> In-Reply-To: From: sud Date: Sat, 8 Jun 2024 14:51:32 +0530 Message-ID: Subject: Re: Long running query causing XID limit breach To: yudhi s Cc: Laurenz Albe , Simon Elbaz , pgsql-general Content-Type: multipart/alternative; boundary="000000000000dc39b2061a5d717f" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000dc39b2061a5d717f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, Jun 6, 2024 at 12:52=E2=80=AFAM yudhi s wrote: > On Wed, Jun 5, 2024 at 3:52=E2=80=AFPM Laurenz Albe > wrote: > >> >> There should never be a restart unless you perform one or the standby >> crashes. >> If you mean that you want to avoid a crash caused by a full disk on the >> standby, >> the answer is probably "no". Make sure that you have enough disk space >> and >> use monitoring. >> >> Yours, >> Laurenz Albe >> > > Is this because OP initially mentioned its RDS postgres, so in that case > there is storage space restriction on 64TB(and 128TB in case of aurora > postgres). So I believe this storage space combines data + WAL , so in th= at > case as you mentioned, appropriate monitoring needs to be put in place. > Or else in the worst case scenario, if the storage consumption hit that > hard limit , then there will be instance restart or crash? > Thank You so much Laurenz and Yudhi. Yes its RDS and as you mentioned there does exist a space limitation of ~64TB but as Laurenz mentioned the only time the second standby may crash would be probably because of the storage space saturation and thus we need to have appropriate monitoring in place to find this and get alerted beforehand. And also a monitoring to see how much WAL gets generated per hour/day to get an idea of the usage. I am not sure how to do it , but will check on this. --000000000000dc39b2061a5d717f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

On Thu, Jun 6, 2024 at 12:52=E2=80=AFAM y= udhi s <learnerdatabase99= @gmail.com> wrote:
On Wed, Jun 5, 2024 at 3:52=E2= =80=AFPM Laurenz Albe <laurenz.albe@cybertec.at> wrote:

There should never be a restart unless you perform one or the standby crash= es.
If you mean that you want to avoid a crash caused by a full disk on the sta= ndby,
the answer is probably "no".=C2=A0 Make sure that you have enough= disk space and
use monitoring.

Yours,
Laurenz Albe

Is this because OP initial= ly mentioned its RDS postgres, so in that case there is storage=C2=A0space = restriction on 64TB(and 128TB in case of aurora postgres). So I believe thi= s storage space combines data=C2=A0+ WAL , so in that case as you mentioned= , appropriate=C2=A0monitoring needs to be put in place.=C2=A0
Or = else in the worst case scenario, if the storage consumption hit that hard l= imit , then there will be instance restart or crash?

Thank You so much Laurenz and Yudhi.
=
Yes its RDS and as you mentioned there does exist=C2=A0a spa= ce limitation of ~64TB but as Laurenz mentioned the only time the second st= andby may crash would be probably because of=C2=A0 the storage=C2=A0space s= aturation and thus we need to have appropriate monitoring in place to find = this and get alerted beforehand. And also a monitoring to see how much WAL = gets generated=C2=A0per hour/day to get an idea of the usage. I am not sure= how to do it , but will check on this.
--000000000000dc39b2061a5d717f--