Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tzGkE-00HZ3Q-OA for pgsql-general@arkaria.postgresql.org; Mon, 31 Mar 2025 15:08:10 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tzGkC-007Gev-PC for pgsql-general@arkaria.postgresql.org; Mon, 31 Mar 2025 15:08:08 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tzGkB-007Gel-SC for pgsql-general@lists.postgresql.org; Mon, 31 Mar 2025 15:08:08 +0000 Received: from fhigh-b2-smtp.messagingengine.com ([202.12.124.153]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1tzGk9-002FIw-00 for pgsql-general@lists.postgresql.org; Mon, 31 Mar 2025 15:08:07 +0000 Received: from phl-compute-01.internal (phl-compute-01.phl.internal [10.202.2.41]) by mailfhigh.stl.internal (Postfix) with ESMTP id 13C2E25401F8; Mon, 31 Mar 2025 11:08:02 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-01.internal (MEProxy); Mon, 31 Mar 2025 11:08:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aklaver.com; h= cc:content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1743433681; x=1743520081; bh=ltcysF74IVFhrwu/KMqeZc7MorveS9ai2K1SFNRiYHU=; b= DMEoJsi4J5m0m4xpEubVbF0yVPeqsAwtt+pbqhjhvY3KA+n4HDobQbTxKHb7qhXN gZtgWd5Ds1RUlbmfDxsRNAQryhFQgv8FViCAFAbFab7Dl+96IkqRAW8pluSqABgd EjqeUwA28Aks/BrXL8UCCV3GF1t7uTA365+BqV5WWHyj/hg1WnnKB9hpH8AHwLwq KmuVFY/RBHKjys2cbEdhPePCFUXIUYUpHQF1VN8LY063iL0Q8Y0MXgCsT5tThTFr uOR7ffAKJQNT91lvLCns2QO++VhRZoRIS5RYI/fmuwANb3eQpjau+ZiOQyGMmSnw oHyJ4pB8hBbRRrFMc6yMVw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; t=1743433681; x=1743520081; bh=l tcysF74IVFhrwu/KMqeZc7MorveS9ai2K1SFNRiYHU=; b=bgUvzDTNvzgf9+l9C kptYJ3w9ebIgTiyF1oFwkUfJpK/cM2axJDoK/vnWZCshs+nDjmVphQz6HrAZ9Esz JokFrU4MyERWjWmN12DeRlTGkcZZiajJaJ5YPRpCobMyCL9VuLk3eahnWVohfGW3 wUQOsQPMfuPdFtV6as7d2TZTGXi4RzxAGzJJIxYYrGpj0c/sCpAjE9rMK+wHFals IhHJZra4POw6jn6mz1a/v7j1bFGGBfsXPj/PQu3vN7riQeFRuXGTTfWXX6WiQQ7C /qph7G9Vzn3AG2Rpe9GqhEnW5ywFb0u5IYM74vYV1PYPmCWDf+SojxI+tv4whuBB 69eWQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddukedtvdegucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucesvcftvggtihhpih gvnhhtshculddquddttddmnecujfgurhepkfffgggfuffvfhfhjggtgfesthekredttddv jeenucfhrhhomheptegurhhirghnucfmlhgrvhgvrhcuoegrughrihgrnhdrkhhlrghvvg hrsegrkhhlrghvvghrrdgtohhmqeenucggtffrrghtthgvrhhnpeffleegieefgfevudeh tdfhkeeutdffjeevgeffgeejvedthefgudeiteefheejheenucevlhhushhtvghrufhiii gvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpegrughrihgrnhdrkhhlrghvvghrsegr khhlrghvvghrrdgtohhmpdhnsggprhgtphhtthhopedvpdhmohguvgepshhmthhpohhuth dprhgtphhtthhopegvuggvnhgrsehlvghgihhtshgvtghurhhithihrdgtohhmpdhrtghp thhtohepphhgshhqlhdqghgvnhgvrhgrlheslhhishhtshdrphhoshhtghhrvghsqhhlrd horhhg X-ME-Proxy: Feedback-ID: i76984098:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon, 31 Mar 2025 11:08:01 -0400 (EDT) Message-ID: <45cfb57b-9f34-4b83-a800-cc62542798ba@aklaver.com> Date: Mon, 31 Mar 2025 08:08:00 -0700 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: RDS IO Read time To: Eden Aharoni , "pgsql-general@lists.postgresql.org" References: Content-Language: en-US From: Adrian Klaver In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 3/31/25 06:54, Eden Aharoni wrote: > Hi all, > > Hopefully, someone here could help us understand whats going on with our > deployment.. > > We are running Postgres 17.4 on AWS RDS on an ec2 instance that has: > > * 32vCPU > * 128GB RAM > * gp3 with 25K IOPS and 4000MiB/s throughput > * the instance supports up to 3125GB/s of throughput. > > Whenever a query fetches data from the disk (index scan, bitmap scans, > etc.) we’re reaching 23 – 30MB/s of IO Read time. > > We changed our autovacuum settings to be more aggressive (0 scale factor > and 10K threshold) so our index only scans will (hopefully) read data > from the disk rarely. However, we can’t optimize all the queries to use > index-only-scan since our users can dynamically select which columns to > see and filtering. > > Is this expected IO read rate? I can’t help but feel we’re missing > something here.. RDS is a black box controlled by AWS, you are going to need to reach out to their tech support. > > Thanks a lot! 😊 > -- Adrian Klaver adrian.klaver@aklaver.com