Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tqDRh-001JwT-7E for pgsql-general@arkaria.postgresql.org; Thu, 06 Mar 2025 15:47:37 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tqDRf-00FhAP-Mf for pgsql-general@arkaria.postgresql.org; Thu, 06 Mar 2025 15:47:35 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tqDRf-00Fh9I-7f for pgsql-general@lists.postgresql.org; Thu, 06 Mar 2025 15:47:35 +0000 Received: from mail-yw1-x1136.google.com ([2607:f8b0:4864:20::1136]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1tqDRd-001KFR-0x for pgsql-general@lists.postgresql.org; Thu, 06 Mar 2025 15:47:34 +0000 Received: by mail-yw1-x1136.google.com with SMTP id 00721157ae682-6efe4e3d698so8162777b3.0 for ; Thu, 06 Mar 2025 07:47:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1741276053; x=1741880853; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=HPxvCFTyRfziFVhsYpq8Y5Hlc8sTo/4glkaeq/O60rs=; b=DTxMuggpFLxVbQW7i/ulcTc+o1gxej1XTjGhAQWoEowseObUm1Xf91LDcQ0T9DqQ5A YW+okGcmSZ/wTA3eVMONlillHZemtZp8EF3NSl3o7XDZ2zwKnsCFXHRVPKAAaT891k1G ylz9EkkOz9JW7ZLACDFKWYb2ydp/IDT/ETCTbjawDBXV+oM8QmoLDQLrpYrWnsSLSmgH PT/D+uh799JfutKHk3McnM/g0YjMPsBquQzD8z/SLrmIGrd0b5cameAU6CL0oHWWg4pA dEvmCUJJB4kZKMm8Tz1GSV1VDLewBE9iUxPKq94UTBWI06yinvXC60OwBJjef6HqHMI7 kDAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741276053; x=1741880853; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HPxvCFTyRfziFVhsYpq8Y5Hlc8sTo/4glkaeq/O60rs=; b=GUCuJGFvu2XJQJ49y6CwVdQ0AaMLXrDX6tVMltjZWD/Y83DOJheVUlGfWdLlCCQMJE 29yMnFrUI8mGEqFk7LiL79BwUxLFiO2d6fxjVpLaHwnbTvrtvQMZk36l9tYNdjyVXWaf 2Yd8MypHaIpapCbke25KIN1K5H5sB4hqkqHOHI/z/kQWx5YNs4S3LHVZQUntJH/ZfstH 56kGd/+VrGkgoEX7LIhOQIjeg9PlaTbd3xc5bZyEWklhdDnMLmp57R1nOgT6cOyqA6G/ vM3Hv7Kn+aGRGsf9AXLrqLg6SuuaCp7TLcYNQCPSHgDQsorNg/AoqZXfCZoiZ9EhxZzK j9Yw== X-Forwarded-Encrypted: i=1; AJvYcCWRf5yrtnTztmr+eyOSd2NtYK4mK8FVV4QjCPGp10Fkz5xlqKKR+pOhU8yjRPNSdRApHKN5P22zHhRmbTzd@lists.postgresql.org X-Gm-Message-State: AOJu0YziAxLtNkUMESsV0SaZQkadla3tpI6Mnk/09BFDdeq2L8EVcdPl FytMWS4W8m9d40CwY3iXiU0pIabxHHgOM/aANiSaC9XqCJ3bcrbQZtLpWx7qgiAMBWjPFNAE8pW QwJ/tzNXXcZQv/Ob00hLCbCyU8cM= X-Gm-Gg: ASbGncu7f6fpbPh+b1rJJ8p/GaronRgvsHyYWDo9YoBf3z9HiaPK7VuowwZ0JJQKb+W cIkZZOL3tMoBq6yPPsis4IZ6/EDBv8Y5mtqbHvIjiAYaf/9EF/r4RXa9pwkReTABuWhL10cdZN8 FKRo7W8sDxaeBtwhBlN4XXdwYO003v9Kativ0nTqruxJa1sImmc1jrQUJaUVHg X-Google-Smtp-Source: AGHT+IHof4DUio2gZDVDrUMEuQn+ju3KkzCMjmOnV5xnT8FauCSWvx9deKLxPNDgS+1WlEYLoxa8VPKo3jPapy7T3lk= X-Received: by 2002:a05:690c:3603:b0:6f9:aecf:ab34 with SMTP id 00721157ae682-6fda308d8d6mr99569257b3.38.1741276052670; Thu, 06 Mar 2025 07:47:32 -0800 (PST) MIME-Version: 1.0 References: <099b49ebae94e23f19afdad3f8c9c6e702a3a2d5.camel@cybertec.at> <6d7e1022-6404-4dab-8467-8d1f6e8b63cb@aklaver.com> In-Reply-To: From: Igor Korot Date: Thu, 6 Mar 2025 09:47:21 -0600 X-Gm-Features: AQ5f1Job8CjwaJlDXTpBs3pd33qT9kiWfb6Mcyc39txLNZeKEib5Eay0RUU20Lk Message-ID: Subject: Re: Quesion about querying distributed databases To: Greg Sabino Mullane Cc: me nefcanto , Adrian Klaver , Laurenz Albe , "pgsql-generallists.postgresql.org" Content-Type: multipart/alternative; boundary="000000000000935045062fae6c44" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000935045062fae6c44 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, On Thu, Mar 6, 2025, 7:32=E2=80=AFAM Greg Sabino Mullane wrote: > On Wed, Mar 5, 2025 at 9:44=E2=80=AFPM me nefcanto wr= ote: > >> Anyway, that's why I asked you guys. However, encouraging me to go back >> to monolith without giving solutions on how to scale, is not helping. >> > > We did. In addition to the ongoing FDW discussion, I mentioned read-only > replicas and Citus. As far as *how* to scale vertically, we can offer > general advice (more hardware resources, ramdisks for temp stuff, OS-leve= l > tuning, separate disk mounts). But a lot of it is tuning Postgres for you= r > specific situation and your specific bottlenecks. Which we are happy to > help with. Once we convince you to not throw the baby out with the > bathwater. :) > > 8 Terabytes of data. A single backup took us more than 21 days > > > Something was fundamentally wrong there. > It could happen on an old and drained hardware... =F0=9F=98=80 Thank you. > Cheers, > Greg > > -- > Crunchy Data - https://www.crunchydata.com > Enterprise Postgres Software Products & Tech Support > > --000000000000935045062fae6c44 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,

On Thu, Mar 6, 2025, 7:32=E2= =80=AFAM Greg Sabino Mullane <htam= fids@gmail.com> wrote:
On Wed, Mar 5, 2025 at 9:44=E2=80=AFPM me nefc= anto <sn.1361@gmail.com> wrote:
Anyway, that's why I asked you guys.= However, encouraging me to go back to monolith without giving solutions on= how to scale, is not helping.

= We did. In addition to the ongoing FDW discussion, I mentioned read-only re= plicas and Citus. As far as *how* to scale vertically, we can offer general= advice (more hardware resources, ramdisks for temp stuff, OS-level tuning,= separate disk mounts). But a=C2=A0lot of it is tuning Postgres for your sp= ecific situation and your specific bottlenecks. Which we are happy to help = with. Once we convince you to not throw the baby out with the bathwater. :)=

8 Terabytes=C2=A0of data. A singl= e backup took us more than 21 days

S= omething was fundamentally wrong there.=C2=A0

It could happen = on an old and drained hardware... =F0=9F=98=80

<= /div>
Thank you.


<= /div>
Cheer= s,
Greg

--
Enterprise Postgres Software Produc= ts & Tech Support

--000000000000935045062fae6c44--