Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tqBL1-000kwD-Ip for pgsql-general@arkaria.postgresql.org; Thu, 06 Mar 2025 13:32:35 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tqBL0-00BdDx-5L for pgsql-general@arkaria.postgresql.org; Thu, 06 Mar 2025 13:32:34 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tqBKz-00BdDf-Q8 for pgsql-general@lists.postgresql.org; Thu, 06 Mar 2025 13:32:33 +0000 Received: from mail-il1-x130.google.com ([2607:f8b0:4864:20::130]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1tqBKx-001J3v-2n for pgsql-general@lists.postgresql.org; Thu, 06 Mar 2025 13:32:32 +0000 Received: by mail-il1-x130.google.com with SMTP id e9e14a558f8ab-3d0465a8d34so5892045ab.0 for ; Thu, 06 Mar 2025 05:32:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1741267951; x=1741872751; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=vV3lSSqm+hndptAXkSZj947SAXYa6fvvHHPyAH8Tbxg=; b=eK+PF2fDK+jm5/aqD4PVrsxLUp1P2+j+B5dUta4IU4g+jveNckvEtW0jRuFcT+GgaD v22oNxWR9+8kSqXIHgWJ6828KawB3DqKCMO7VjAxVwb//AH75ytWQNc0o1/aQCtO6u3u M4J/SxFhOWPg+b9QzY/YX7hllLrXnHd1f4PGE0xt2uMdMdG09HIIK5LG0IacHfwkQPNS hlOraRhJibZknYc7xe0oxecvoxkZaP81WDGtho9aNQJKr9s9ckWq1Nc5eReJsVOO9Py8 FjDuug6FC6y0yGZwSzsOV6RTFxjngYubBh/3viBloM1Zq/gnVez/GJk2hiQhsFSn05j6 3mkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741267951; x=1741872751; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=vV3lSSqm+hndptAXkSZj947SAXYa6fvvHHPyAH8Tbxg=; b=VwznOZGqf9mKFz8UysNlZSHWUuSZaieLiDB06GOW2w2LLEDL4WPxr0/g9IMhjn5IE+ K5of6mrIFI1fWmzGQS+FQHtuccZFRwN36RACNwIIqOcxA4BGVRf7fN4dEYr2VfXs6FY6 KKiPi5iv0ZOXMDxBX477JiN5wpLzVoO6QoqryiKHU5DwvRB/upK0iMg4vmExjdjBrhpr jSRftsxV67nCK5aBpEDDU3I+Qsm+QlKcP15VGVwKerE7qI8cRp9yWM4bRL5FH3vHFqvz DqaRzhdP8+3j+ysESyIVbaWNTmfqzkcFTLKw7v6cMbo0QXwSp8CK0HwGdMX0JkTWAUdl AFcQ== X-Forwarded-Encrypted: i=1; AJvYcCUsiBdGnwBNhCw2qrVK6ydY/NjqZaHAXwauJshiiY7DZrJFSbWdMHFy1T4RRCIsY291GkqoNa0ONE4LKBdO@lists.postgresql.org X-Gm-Message-State: AOJu0Yx/y+JfvdzjRxp78+x4J+M1cdUi6osf/LKj7vZqSZ2M7i44JbZC hDX3ZM0sFrTit65CGSA55EIIrZR3TYB6f14fA3Q0bFwuE9DLuUAGwtMrsT0TQ2pFG0s2f1Gzsom kQ+wTrC06E+RfiuNjSfDt7QgWeXQ= X-Gm-Gg: ASbGncvd2bbBXPAeULHRK5RoZWiXUZMMzOPYCFdyMANNZRuw2BHccy1g/5eg3ZUxBFP yRFxMmligV7PkjuwxSfebwYre+TsNQ4pfqfWUG+1GNC5PNSIgauiOSVn0pU2wRh6tiIAJgurqkD t83NsFiORiHNNPFQC8FvOJxXVllqxXd5mXYptTvoHaiDuzBP0GBkQjkBxaDehH X-Google-Smtp-Source: AGHT+IGVV5MOezaDQnEADD8aTeiiQ9E16PIjJ4UqnfSt2bCvjP0meAp1XiB7Nzohx5nqXPM2dv0miuLGZfCTZYvzH9w= X-Received: by 2002:a92:c247:0:b0:3d4:3d5d:cf7e with SMTP id e9e14a558f8ab-3d43d5dd1admr13783505ab.16.1741267950457; Thu, 06 Mar 2025 05:32:30 -0800 (PST) MIME-Version: 1.0 References: <099b49ebae94e23f19afdad3f8c9c6e702a3a2d5.camel@cybertec.at> <6d7e1022-6404-4dab-8467-8d1f6e8b63cb@aklaver.com> In-Reply-To: From: Greg Sabino Mullane Date: Thu, 6 Mar 2025 08:31:54 -0500 X-Gm-Features: AQ5f1JoDvjG3bKmX55kUS48_uTy6CLjZtiI8WRMu40aZ76n6SxHnCB5FdxeXAWE Message-ID: Subject: Re: Quesion about querying distributed databases To: me nefcanto Cc: Adrian Klaver , Laurenz Albe , pgsql-general@lists.postgresql.org Content-Type: multipart/alternative; boundary="000000000000a55bfe062fac8980" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000a55bfe062fac8980 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Wed, Mar 5, 2025 at 9:44=E2=80=AFPM me nefcanto wrot= e: > Anyway, that's why I asked you guys. However, encouraging me to go back t= o > monolith without giving solutions on how to scale, is not helping. > We did. In addition to the ongoing FDW discussion, I mentioned read-only replicas and Citus. As far as *how* to scale vertically, we can offer general advice (more hardware resources, ramdisks for temp stuff, OS-level tuning, separate disk mounts). But a lot of it is tuning Postgres for your specific situation and your specific bottlenecks. Which we are happy to help with. Once we convince you to not throw the baby out with the bathwater. :) 8 Terabytes of data. A single backup took us more than 21 days Something was fundamentally wrong there. Cheers, Greg -- Crunchy Data - https://www.crunchydata.com Enterprise Postgres Software Products & Tech Support --000000000000a55bfe062fac8980 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Wed, Mar 5, 2025 at 9:44=E2=80=AFPM me= nefcanto <sn.1361@gmail.com>= ; wrote:
Anyway, that's why I asked you guys. However, = encouraging me to go back to monolith without giving solutions on how to sc= ale, is not helping.

We did. In= addition to the ongoing FDW discussion, I mentioned read-only replicas and= Citus. As far as *how* to scale vertically, we can offer general advice (m= ore hardware resources, ramdisks for temp stuff, OS-level tuning, separate = disk mounts). But a=C2=A0lot of it is tuning Postgres for your specific sit= uation and your specific bottlenecks. Which we are happy to help with. Once= we convince you to not throw the baby out with the bathwater. :)

8 Terabytes=C2=A0of data. A single backup t= ook us more than 21 days

Something w= as fundamentally wrong there.=C2=A0

Cheers,
Greg<= /div>

--
Enterprise Postgres Software Products & Tech Support

<= /div>
--000000000000a55bfe062fac8980--