Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w09E5-001emT-2X for pgsql-hackers@arkaria.postgresql.org; Wed, 11 Mar 2026 02:23:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1w09E4-007ADx-0q for pgsql-hackers@arkaria.postgresql.org; Wed, 11 Mar 2026 02:23:08 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w09E3-007ADh-3A for pgsql-hackers@lists.postgresql.org; Wed, 11 Mar 2026 02:23:08 +0000 Received: from mail-ed1-x535.google.com ([2a00:1450:4864:20::535]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.98.2) (envelope-from ) id 1w09E2-00000001XhW-0tj8 for pgsql-hackers@lists.postgresql.org; Wed, 11 Mar 2026 02:23:07 +0000 Received: by mail-ed1-x535.google.com with SMTP id 4fb4d7f45d1cf-662e7450a8aso1998609a12.0 for ; Tue, 10 Mar 2026 19:23:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1773195785; cv=none; d=google.com; s=arc-20240605; b=IJ2uqjPuYQozMa142zTmF2FXX9IXw1h2gQPlPYm4gBVGZtZSriQgHUp5pq+/xOFgfF Dq/o7EalG1xwYqdUf+cdzPz6FVes/kfXfG4wo46zI4vpNIaBkE4BMcw2pHXcqPTlSKYN 6LnlANWRUQEsJV55VBefB/66lCCjJKVsf/Z21SIb0a5EmjqypSZrBg1EjmJt5NNf49Nz i8B1gvArB9Bdqe3np+YIg1P+2LIdU7JFEKDRY+WgETOAE0LI5PFW2CK2SrsJRDRObDh0 Ga5dzAQ0NdQygQ88LFq8yFj1vCNekwrYLqrHl1NqOYX+xzx8HW/W/1PiCevJnsL6zdUk JovQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=8Jqs8od5gHe25kRFSnOGygHzr3e24Dytx4jQOnh3jHI=; fh=fWZZ/hCOKWMpLCOQsgQbE1fpbsAwUHo0zwK6HR1y4Og=; b=bUdmt69RNoUTzGjQLrc3qWGkbugTM6Fa92wj9TcavOe7DSRHZJ8aiFwoOyW5vxT/9p XKyR/omSiZ8XzCxT1dUvYfNNGAFAUXTJAoCJaFUW686uk89Sn8PasuTrSHd5z8RtgmQb jJSk/X/8G2SBmG1CumLPSG4C6nf8SGWoWzNH09epzLLjoD6R+AVoMYT/Aev6Ro4v7wiC 9/nlNts6ikvZbYI1i4lXBHO/wy8VnCFGAnmrjra3Xsmjj+WHxuOLhEvB06PihPWjNl43 yMkz2Hj3ArImcfU5UXuRBC2zmtuvLACyr9R/fZ3+7dnQGQCV00hqBxrCDKr0H601/dZY 85Ag==; darn=lists.postgresql.org ARC-Authentication-Results: i=1; mx.google.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1773195785; x=1773800585; darn=lists.postgresql.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=8Jqs8od5gHe25kRFSnOGygHzr3e24Dytx4jQOnh3jHI=; b=BzuPsJoWUXDHs1X4TkgI8Q4hZI68AlT46saCCluXrIjq8dfMLrkdISzEfHMqapMuMW f3Od5T34Y/Ib4eFM4xFt/B9Wed3W2+POS/TnBeU53N+1EPDgKY+75YLKRz3oTNOhHiLv IMiJXdVrs6XFjqLz/ENeVLY2HDFKc9o+BXhag+kTxLImEhTO1qCypCmKBkaWZKvUCLsT 8yqnqZHJxBqj3TEDgZZitdhEiL4gHL0sbkFo2Lig1GeuOZc2g/gu9KmjYIdasacDZYNC 5UFBsuLcEJSkJqU/j2Pm/fosQzSjDH8hzDeiLZlKXoQBA9cJMYDaxCsGlO77JYx02KBx /cDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1773195785; x=1773800585; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=8Jqs8od5gHe25kRFSnOGygHzr3e24Dytx4jQOnh3jHI=; b=FA81NC6x8bhVJaBd4P/HY3TgFQ+7wqJCx81aAf8oOl/mpKD8x2l9hufug1XMVoluOF XB38FisrCRfL+zo9WxrqWVHEunmew/nzCnINN7jqg9Hpq0mPv++66GbDMr4G6C8pJBXO +MwaKT4v5BwBwdX8VXs9px3PDb0AhFjDwyWZwB7Dt7R9ArrwztW5kZno8qiWsh1PXRgj fWcs1sZ0j4cUFDNE08twH8wpzPOoAcfxrxejGTPmiMK7y2Ppv03rktE91PaSrKIy0Gt2 6vkoIj9P9LDKcJ+b7v7vFk4MHtczuaAyv45zYZ149abYx0mX/GEPoiSv50uABRSwlhre B69g== X-Forwarded-Encrypted: i=1; AJvYcCXOtIP81nYeqdw43EmXH+9vbnGX1hm++yUznSYxKxTHy7t7PhANwtLjhzwxjGlUgjcTTPU7d6669Ol5MeWX@lists.postgresql.org X-Gm-Message-State: AOJu0Yy5Em5Df0f8BFujq43JFgkiBqDd4q8U5dD2B495pmo8Hx5BxjHx ikDrynatVAydCUz6ZRcJMpxGF01jB3qUtARzK9o9dTxlPXMzHP3tlvhK/3WXBLf1JAW96s7J5Cw ebNL9COR7mDdbVruCNggeueCSc9Kg4k0= X-Gm-Gg: ATEYQzyDzP/nYWRZLB64e6sBn9IW7RAVRlgxa2cfsWlhMwGoVTul2xOj2d3qvVh7y1j 8sgbKlwbhMsBJy643OEkQkhIJq2q6EZnPkPxW2bO2dCr35MwK3R+2JnOFz/mUfPo/QvRGmWsgRH QBH8mBacFUgb0wJYEUAof5l9rJ78XL9MIxG5f9nB957qAphzgObt2FkpSPnj/qud0IKDgdcAzfE 7YGT530+hcXVuyI4bZHqKGDfc6/qAQx0h3ic0LCD/1WsPoVe8korIkXVnfdKiYDPtzPC1afFIIq yPorcgjiuu4duqJNUbGU9zvVsjD76ahmi0Lq5cjPIZzV2lZmK4DG/jl2CrQWT0cM5UIlCluXTNc urLX7IzLl X-Received: by 2002:a05:6402:42c8:b0:662:dc63:c80 with SMTP id 4fb4d7f45d1cf-66319ee1e15mr368371a12.22.1773195784693; Tue, 10 Mar 2026 19:23:04 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Xuneng Zhou Date: Wed, 11 Mar 2026 10:22:51 +0800 X-Gm-Features: AaiRm52FbY_osU0IIhFkO9hQk6MlcE5jaE-wkWvL-Wuvtif9ZTJ5P6VL7-Bnm60 Message-ID: Subject: Re: Streamify more code paths To: Michael Paquier Cc: Andres Freund , pgsql-hackers , Nazir Bilal Yavuz Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Hi, On Wed, Mar 11, 2026 at 7:29=E2=80=AFAM Michael Paquier wrote: > > On Tue, Mar 10, 2026 at 07:04:37PM -0400, Andres Freund wrote: > > It might be a good idea to run the benchmarks with debug_io_direct=3Dda= ta. > > That'll make them very slow, since the write side doesn't yet use AIO a= nd thus > > will do a lot of synchronous writes, but it should still allow to evalu= ate the > > gains from using read stream. > > Ah, thanks for the tip. I'll go try that. > > > The other thing that's kinda important to evaluate read streams is to t= est on > > higher latency storage, even without direct IO. Many workloads are not= at all > > benefiting from AIO when run on a local NVMe SSD with < 10us latency, b= ut are > > severely IO bound when run on a cloud storage disk with 0.5ms - 4ms lat= ency. > > My previous run was on a cloud instance, I don't have access to a SSD > with this amount of latency locally. > > One thing that was standing on is the bloom bitmap case that was > looking really nice for a large number of rows, so I have applied > this part. The rest is going to need a bit more testing to build more > confidence, as far as I can see. > -- > Michael Thanks for pushing that. I=E2=80=99ll update the script with Andres=E2=80= =99 suggestions and share it shortly. --=20 Best, Xuneng