pg.ddx.io  pgsql-general@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Ilya Basin <basinilya@gmail.com>
To: Thomas Kellerer <shammat@gmx.net>
To: laurenz.albe@cybertec.at
Cc: pgsql-general@lists.postgresql.org
Subject: Re: Query plans not identical for `id in(1,2,3)` and `(id=1 or id=2 or id=3)`
Date: Mon, 11 Mar 2024 00:51:21 +0400
Message-ID: <8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com> (raw)
In-Reply-To: <8f0fefa7-54ce-4bca-a1ef-84a70f0b7663@gmx.net>
References: <0cf29b7e-3e9e-4698-81e3-aad5bb37f446@gmail.com>
	<8f0fefa7-54ce-4bca-a1ef-84a70f0b7663@gmx.net>

Laurenz thanks for the info.

Thomas no I can't.

-------- Original Message --------
From: Thomas Kellerer [mailto:shammat@gmx.net]
Sent: Sunday, March 10, 2024 at 11:58 UTC
To: pgsql-general@lists.postgresql.org
Subject: Query plans not identical for `id in(1,2,3)` and `(id=1 or id=2 or id=3)`

Ilya Basin schrieb am 09.03.2024 um 20:08:
Hi List.

I have a list of bigint keys and I need to retrieve rows by these keys. Normally, I would split this list into pages of size 900 and perform several `SELECT ... WHERE key in($1,$2,...)`. However, the proprietary ORM we use can only produce this SQL: `SELECT ... WHERE (key=$1 or key=$2 or ...)`. Surprisingly, PostgreSQL planner treats these two SQLs differently:

- ```select * FROM "audittrail$referencelogline" where id in ( 1 , 2 , 3 )```

Index Scan
https://i.stack.imgur.com/dr8oz.png

- ```select * FROM "audittrail$referencelogline" where id = 1 or id = 2 or id = 3```

A lot of "Bitmap Index Scan" for each value
https://i.stack.imgur.com/dnErs.png

Is it possible to configure PostgreSQL 12.16 to treat the second query as the first?

Can you convince your obfuscation layer to send an array value (containing all IDs) and change the query to:

    select * FROM "audittrail$referencelogline" where id = any(?)









view thread (4+ messages)

Message-ID: <8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com>
Permalink:  ../8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com/
Also on:    postgresql.org/message-id/8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-general@postgresql.org
  Cc: basinilya@gmail.com, shammat@gmx.net, laurenz.albe@cybertec.at
  Subject: Re: Query plans not identical for `id in(1,2,3)` and `(id=1 or id=2 or id=3)`
  In-Reply-To: <8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com>
  References: <0cf29b7e-3e9e-4698-81e3-aad5bb37f446@gmail.com> <8f0fefa7-54ce-4bca-a1ef-84a70f0b7663@gmx.net> <8fa3f3c5-7515-4672-b652-73167a08bbf4@gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox