Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1xFExz-00000001V7h-21dp for pgsql-general@arkaria.postgresql.org; Fri, 09 Oct 2026 18:05:11 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.98.2) (envelope-from ) id 1xFExw-00000000poy-2wB2 for pgsql-general@arkaria.postgresql.org; Fri, 09 Oct 2026 18:05:08 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1xFExw-00000000poq-0u3i for pgsql-general@lists.postgresql.org; Fri, 09 Oct 2026 18:05:08 +0000 Received: from mail-dy1-x132d.google.com ([2607:f8b0:4864:20::132d]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.98.2) (envelope-from ) id 1xFExt-00000001GlJ-3ial for pgsql-general@lists.postgresql.org; Fri, 09 Oct 2026 18:05:07 +0000 Received: by mail-dy1-x132d.google.com with SMTP id 5a478bee46e88-3535dd9a601so124418eec.0 for ; Fri, 09 Oct 2026 11:05:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1791569103; x=1792173903; darn=lists.postgresql.org; h=mime-version:content-transfer-encoding:content-type:references :in-reply-to:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to:content-type; bh=lV+YNWpIYpTkeMar2/9aMgvsyHo5C73m9rFS4H08gL4=; b=YrzU+IgRRi3OyFGDYMAG2wjsUvR+662isj8HFpjDxs9hk7TZxmkuwAJDf+uIS48lRC XgZThjudBnBTKpUchBlPbdvlq9LDqd8d2QtD4WxOaoD5erpKBKyuKw7k+JdASorOmZls Lh99xyBstdKnN8ORf3kq77nPSL9RY/V262CoNnPXObKDC+zOQ4URyLu3triauQlLFAp4 PkyOWq5mCM9TD/ikG61npDHg4CKwZ99dQkKIEWzLh4ycZoyATY/lw/8YPB2S7ROhyQdl CYLdrhVUt6LE9mnnGUnuFTbvvNkZ+kQIXL46F3HPjKc8sCZxx+Kx6zHKvZ9lESzgojKB IBqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1791569103; x=1792173903; h=mime-version:content-transfer-encoding:content-type:references :in-reply-to:message-id:date:subject:cc:to:from:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=lV+YNWpIYpTkeMar2/9aMgvsyHo5C73m9rFS4H08gL4=; b=hpPK+tknHAsk3i+b1wd4fHNXAIvdLJPYh6Pz2p1w0kPiw3WQiJ9VLp5IfEJrd2SS3F Dic14bNQE8oKmeXsry4IOtOd5K68ZovpELr0pO9Ku7hJXm33zVzbYUo3ectn6W+1IU0x Mjt8n529lvg+v+wk+KeiduOC93ZakCozO+zFgsw3B4Na5Njhwlpi+BUYb5d1X5MNGwK4 3wBxJMz217synN1gbXjdep9yvm5o393Zq+s0WyshXJ4xB5aPg4igouOmP8hNQeezMEhU cH4ZUnHvLhFBjQaAd2XlAISXiEMHV1id94mteTV1So/GElUeAZjl2HbQcqi0dUAw4VdX nh2A== X-Gm-Message-State: AFuF++mjXG/lNDsn9uySsgAj6bFebDwt5n6iVcn3mvdKSRLVIRHMeAa3 4+QVKJ8YRWTvCGFoaBvdjSAzHLGYSOPsHhAo5F8Ko3aTwb6sGgSagHGrcp1x3/eb X-Gm-Gg: AYBFou330mpgnpRt0g+jlF0eVqicQdp6I8NnNS+In0Yl7dn+0pvSXPgqIShi9z1YKZK kGL25jfha4cjsfyIU2TeNhZylOMkRiR0DD5f0jqwLfiy9z5m/v8JN0o+mY5BZoH7hLNrkCIXPjw z0MMhdoi7UsuusKKmSevqUVz40ZZy42E7ONdHxUlG38AQhfJdM5BTKcUTEqKaldP6YmRis8JdjQ BvBEwGL3SIigBCbtdE2eWVYn5O6wB/9OUn6sWYP5tp6PALADr8s5eOQTH477gHDIydWmJBLi4Lr GdUiOBGEG8uKbTRU8eHpVl4kHQezI/hoCUPcmvOyEK3ywpdwi/lNyZzqOBmmiJzTEskrIK2Lcm8 2QjtMUfc48tnlYANLvu4BRcWLXOWW//Wz/MXxFbGZ43flFTqZLlsCdis0ZQG9hvYMeuW40w29JW jpME6MmRlvPul/sf4GbVWa303NpfkXBZe/a9qXbB4KG3DuUUbC1pC2LiRlqqdJtt1z1I6z1S3T5 a51lMs+hnR2R8j/dhGo0VBg+yxf7p6Sj7/UOZXpJePhful79qfFWbzOLfrfHImqDUWjfaJYwnsq ZtrjbNnVkUePV0GlRmAxjS5BvQ== X-Received: by 2002:a05:701b:260e:b0:149:c766:2965 with SMTP id a92af1059eb24-16a5ce96c25mr5485495c88.2.1791569102831; Fri, 09 Oct 2026 11:05:02 -0700 (PDT) Received: from 192.168.1.109 ([2803:3c90:cee:ea00:5c3c:7e70:29e3:7a55]) by smtp.gmail.com with ESMTPSA id a92af1059eb24-169a31f6be0sm16111476c88.13.2026.10.09.11.05.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 09 Oct 2026 11:05:02 -0700 (PDT) From: Manu To: pgsql-general@lists.postgresql.org Cc: kavya chandren , Adrian Klaver Subject: Re: Challenges with huge postgresql deployments in 300+ TBs Date: Fri, 09 Oct 2026 15:04:58 -0300 Message-ID: <179156909812.373782.3765533734963931820@gmail.com> In-Reply-To: References: Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi Kavya, > 3. Fixing a standby that lags a lot Of the operational walls, this is the one I would size before committing rather than after, so I put together a small harness that turns it into a number: it loads indexed data, pauses replay to separate WAL generation from replay, then times pure replay from local WAL and reports MB/s with a 95% CI and a lag curve. About 15 minutes on a couple hundred MB, and it refuses assert-enabled builds so the timing is real: https://github.com/Manuelreyesbravo/standby-replay-ceiling The numbers are hardware-specific -- one laptop core replays around 190 MB/s here, CPU-bound. The point is to run it on a subset of your intended storage and CPU and get your own ceiling before building the full system, which matches Adrian's start-from-a-test-setup suggestion; whether one replay core keeps up then depends on how much WAL your write workload generates. It measures that wall, it does not move it. Happy to adjust it if your setup would test differently. Regards, Manu