Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rkT7t-00Cv9g-10 for pgsql-hackers@arkaria.postgresql.org; Wed, 13 Mar 2024 18:14:53 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1rkT7q-009qgJ-VA for pgsql-hackers@arkaria.postgresql.org; Wed, 13 Mar 2024 18:14:51 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1rkT7q-009qZf-KF for pgsql-hackers@lists.postgresql.org; Wed, 13 Mar 2024 18:14:51 +0000 Received: from mail-ej1-x62f.google.com ([2a00:1450:4864:20::62f]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1rkT7l-004KRo-Dr for pgsql-hackers@postgresql.org; Wed, 13 Mar 2024 18:14:49 +0000 Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-a466a1f9ea0so17765766b.1 for ; Wed, 13 Mar 2024 11:14:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=enterprisedb.com; s=google; t=1710353685; x=1710958485; darn=postgresql.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=EJoUqj9aX0/jWmhsdCg4M9nNaMomEsi8u0UUph5Y264=; b=MUU6y9FoG2nMP4X7ptY+rNN3kC2L+c2qJjYLj7tPx361ORfcnktjkeNJYMvrz4Szrn rkK5IR6gD+bqEq7T9aBHt/03w/b9FXPONlUDgdxhpi9KxfpWkDXPtQvB3HrTHnId2BCk z0+Epgs8cH0FV5NVDScThka1DQIje3t3QLoeIa0WSZv3nKyL5Wklhr3nvgx2wrJGDHEt QmGy8RkIOulppTi54qSA04QdEj7xZvLaghfeSImWJyNv9OsxRTr4ciIWpierBj1MAJ1Z hM4SeuepqIVAwyg9hev3TxvG/E2VKjvQ5fDW6/ADCLi3wE4I4XwZ5TvhQcD2s0EwErSL vlFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1710353685; x=1710958485; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=EJoUqj9aX0/jWmhsdCg4M9nNaMomEsi8u0UUph5Y264=; b=g8x8o3zLxuURsRtj7QsCYwkI63bmOwG5NgzxTw/Ao1/7DIM+eg+x9K14ARiLsM3Vm7 hEaYmyxhOjLk9Nfyjjm2hFBfhtq6pCtvZNNvYDFbvneKDsdiKNzMRW3NnpM1RJ/VutZR aQbMdH0HQ4NJXrUbJCa+cApRY4FO1A9DzF3qPfgS7OiQkYt7aECdOyJ9u3gWMMYj1Ccz 1YrX5hAEf67s/KBggZ03nU6aaip0NL7KTJhpLQm3TKTPwypJTRjVEiBmqSXsTcgHLcv/ c1qBKZR7l9z8A5r1HVpwN01rOjNcu3lu04GFx+pGQRu9gX8HyKlu12UdBJuNM91ufwMU O3kQ== X-Forwarded-Encrypted: i=1; AJvYcCX8Vhu42FKmuBm77uTqGGwHRmmxCrq4zh4hAL3DM51m20+QgCuHX1eDFauRYSy5hZl9ReW9/k2pFLrkLu/59xb5ChZ0o7pttEYoP7L6 X-Gm-Message-State: AOJu0Yxp99GueRK+RNhHJhlxOrNtlEa/lvicP5GzDqT4mie/hKhZKIM4 QpnYcfUGanmeP9ZrzDBdo8Y7qSmmgeKq9ylBMUaH5UfDBjraHR9Wd2fvvCYsqA== X-Google-Smtp-Source: AGHT+IHpCZPaEfgwhhUQyVdpVDO4Rsgjtl5i+1dzzi+xLn0KLekNAu+vJkbupoXR/nwWc2mXy/t0TA== X-Received: by 2002:a17:907:1819:b0:a46:5e14:1919 with SMTP id lg25-20020a170907181900b00a465e141919mr1601348ejc.63.1710353684667; Wed, 13 Mar 2024 11:14:44 -0700 (PDT) Received: from [10.137.0.18] (cst-prg-15-187.cust.vodafone.cz. [46.135.15.187]) by smtp.gmail.com with ESMTPSA id jw18-20020a170906e95200b00a462520d561sm3347581ejb.54.2024.03.13.11.14.40 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 13 Mar 2024 11:14:44 -0700 (PDT) Message-ID: Date: Wed, 13 Mar 2024 19:14:36 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: BitmapHeapScan streaming read user and prelim refactoring To: Heikki Linnakangas , Dilip Kumar , Melanie Plageman Cc: Nazir Bilal Yavuz , Andres Freund , Pg Hackers , Thomas Munro References: <20240214194228.jf4o7luxtyra5ggv@awork3.anarazel.de> <20240216173559.xiy5xcl5dqmsprns@liskov> <20240227015028.knohvy3spaqwk7lf@liskov> <20240227142230.nu3ytvcjwouvczlt@liskov> <5f3b9d59-0f43-419d-80ca-6d04c07cf61a@iki.fi> Content-Language: en-US From: Tomas Vondra In-Reply-To: <5f3b9d59-0f43-419d-80ca-6d04c07cf61a@iki.fi> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 3/13/24 14:34, Heikki Linnakangas wrote: > ... > > Lots of discussion happening on the performance results but it seems > that there is no performance impact with the preliminary patches up to > v5-0013-Streaming-Read-API.patch. I'm focusing purely on those > preliminary patches now, because I think they're worthwhile cleanups > independent of the streaming read API. > Not quite true - the comparison I shared on 29/2 [1] shows a serious regression caused by the 0010 patch. We've been investigating this with Melanie off list, but we don't have any clear findings yet (except that it's clearly due to moving BitmapAdjustPrefetchIterator() a bit down. But if we revert this (and move the BitmapAdjustPrefetchIterator back), the regression should disappear, and we can merge these preparatory patches. We'll have to deal with the regression (or something very similar) when merging the remaining patches. regards [1] https://www.postgresql.org/message-id/91090d58-7d3f-4447-9425-f24ba66e292a%40enterprisedb.com -- Tomas Vondra EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company