pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
pgsql: Fix overflow when calculating timestamp distance in BRIN
4+ messages / 1 participants
[nested] [flat]

* pgsql: Fix overflow when calculating timestamp distance in BRIN
@ 2023-10-27 16:57  Tomas Vondra <tomas.vondra@postgresql.org>
  0 siblings, 0 replies; 4+ messages in thread

From: Tomas Vondra @ 2023-10-27 16:57 UTC (permalink / raw)
  To: pgsql-committers@lists.postgresql.org

Fix overflow when calculating timestamp distance in BRIN

When calculating distances for timestamp values for BRIN minmax-multi
indexes, we need to be careful about overflows for extreme values. If
the value overflows into a negative value, the index may be inefficient.

The new regression test checks this for the timestamp type by adding a
table with enough values to force range compaction/merging. The values
are close to min/max, which means a risk of overflow.

Fixed by converting the int64 values to double first, before calculating
the distance. This prevents the overflow. We may lose some precision, of
course, but that's good enough. In the worst case we build a slightly
less efficient index, but for large distances this won't matter.

This only affects minmax-multi indexes on timestamp columns, with ranges
containing values sufficiently distant to cause an overflow. That seems
like a fairly rare case in practice.

Backpatch to 14, where minmax-multi indexes were introduced.

Reported-by: Ashutosh Bapat
Reviewed-by: Ashutosh Bapat, Dean Rasheed
Backpatch-through: 14
Discussion: https://postgr.es/m/eef0ea8c-4aaa-8d0d-027f-58b1f35dd170@enterprisedb.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/b5489b75c6ce9517ab5f9d6f1d98bc928f6d5bd5

Modified Files
--------------
src/backend/access/brin/brin_minmax_multi.c |  2 +-
src/test/regress/expected/brin_multi.out    | 15 +++++++++++++++
src/test/regress/sql/brin_multi.sql         | 21 +++++++++++++++++++++
3 files changed, 37 insertions(+), 1 deletion(-)



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* pgsql: Fix overflow when calculating timestamp distance in BRIN
@ 2023-10-27 16:58  Tomas Vondra <tomas.vondra@postgresql.org>
  0 siblings, 0 replies; 4+ messages in thread

From: Tomas Vondra @ 2023-10-27 16:58 UTC (permalink / raw)
  To: pgsql-committers@lists.postgresql.org

Fix overflow when calculating timestamp distance in BRIN

When calculating distances for timestamp values for BRIN minmax-multi
indexes, we need to be careful about overflows for extreme values. If
the value overflows into a negative value, the index may be inefficient.

The new regression test checks this for the timestamp type by adding a
table with enough values to force range compaction/merging. The values
are close to min/max, which means a risk of overflow.

Fixed by converting the int64 values to double first, before calculating
the distance. This prevents the overflow. We may lose some precision, of
course, but that's good enough. In the worst case we build a slightly
less efficient index, but for large distances this won't matter.

This only affects minmax-multi indexes on timestamp columns, with ranges
containing values sufficiently distant to cause an overflow. That seems
like a fairly rare case in practice.

Backpatch to 14, where minmax-multi indexes were introduced.

Reported-by: Ashutosh Bapat
Reviewed-by: Ashutosh Bapat, Dean Rasheed
Backpatch-through: 14
Discussion: https://postgr.es/m/eef0ea8c-4aaa-8d0d-027f-58b1f35dd170@enterprisedb.com

Branch
------
REL_16_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/0635fe02b426573d62e2389cf90b688c285f072a

Modified Files
--------------
src/backend/access/brin/brin_minmax_multi.c |  2 +-
src/test/regress/expected/brin_multi.out    | 15 +++++++++++++++
src/test/regress/sql/brin_multi.sql         | 21 +++++++++++++++++++++
3 files changed, 37 insertions(+), 1 deletion(-)



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* pgsql: Fix overflow when calculating timestamp distance in BRIN
@ 2023-10-27 16:59  Tomas Vondra <tomas.vondra@postgresql.org>
  0 siblings, 0 replies; 4+ messages in thread

From: Tomas Vondra @ 2023-10-27 16:59 UTC (permalink / raw)
  To: pgsql-committers@lists.postgresql.org

Fix overflow when calculating timestamp distance in BRIN

When calculating distances for timestamp values for BRIN minmax-multi
indexes, we need to be careful about overflows for extreme values. If
the value overflows into a negative value, the index may be inefficient.

The new regression test checks this for the timestamp type by adding a
table with enough values to force range compaction/merging. The values
are close to min/max, which means a risk of overflow.

Fixed by converting the int64 values to double first, before calculating
the distance. This prevents the overflow. We may lose some precision, of
course, but that's good enough. In the worst case we build a slightly
less efficient index, but for large distances this won't matter.

This only affects minmax-multi indexes on timestamp columns, with ranges
containing values sufficiently distant to cause an overflow. That seems
like a fairly rare case in practice.

Backpatch to 14, where minmax-multi indexes were introduced.

Reported-by: Ashutosh Bapat
Reviewed-by: Ashutosh Bapat, Dean Rasheed
Backpatch-through: 14
Discussion: https://postgr.es/m/eef0ea8c-4aaa-8d0d-027f-58b1f35dd170@enterprisedb.com

Branch
------
REL_15_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/daa7b0d7ce149b0f7f9d68dfae0c2483a7ba5e98

Modified Files
--------------
src/backend/access/brin/brin_minmax_multi.c |  2 +-
src/test/regress/expected/brin_multi.out    | 15 +++++++++++++++
src/test/regress/sql/brin_multi.sql         | 21 +++++++++++++++++++++
3 files changed, 37 insertions(+), 1 deletion(-)



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* pgsql: Fix overflow when calculating timestamp distance in BRIN
@ 2023-10-27 16:59  Tomas Vondra <tomas.vondra@postgresql.org>
  0 siblings, 0 replies; 4+ messages in thread

From: Tomas Vondra @ 2023-10-27 16:59 UTC (permalink / raw)
  To: pgsql-committers@lists.postgresql.org

Fix overflow when calculating timestamp distance in BRIN

When calculating distances for timestamp values for BRIN minmax-multi
indexes, we need to be careful about overflows for extreme values. If
the value overflows into a negative value, the index may be inefficient.

The new regression test checks this for the timestamp type by adding a
table with enough values to force range compaction/merging. The values
are close to min/max, which means a risk of overflow.

Fixed by converting the int64 values to double first, before calculating
the distance. This prevents the overflow. We may lose some precision, of
course, but that's good enough. In the worst case we build a slightly
less efficient index, but for large distances this won't matter.

This only affects minmax-multi indexes on timestamp columns, with ranges
containing values sufficiently distant to cause an overflow. That seems
like a fairly rare case in practice.

Backpatch to 14, where minmax-multi indexes were introduced.

Reported-by: Ashutosh Bapat
Reviewed-by: Ashutosh Bapat, Dean Rasheed
Backpatch-through: 14
Discussion: https://postgr.es/m/eef0ea8c-4aaa-8d0d-027f-58b1f35dd170@enterprisedb.com

Branch
------
REL_14_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/90c4da6d4392dc45de4182cd433cd91026e39222

Modified Files
--------------
src/backend/access/brin/brin_minmax_multi.c |  2 +-
src/test/regress/expected/brin_multi.out    | 15 +++++++++++++++
src/test/regress/sql/brin_multi.sql         | 21 +++++++++++++++++++++
3 files changed, 37 insertions(+), 1 deletion(-)



^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2023-10-27 16:59 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2023-10-27 16:57 pgsql: Fix overflow when calculating timestamp distance in BRIN Tomas Vondra <tomas.vondra@postgresql.org>
2023-10-27 16:58 pgsql: Fix overflow when calculating timestamp distance in BRIN Tomas Vondra <tomas.vondra@postgresql.org>
2023-10-27 16:59 pgsql: Fix overflow when calculating timestamp distance in BRIN Tomas Vondra <tomas.vondra@postgresql.org>
2023-10-27 16:59 pgsql: Fix overflow when calculating timestamp distance in BRIN Tomas Vondra <tomas.vondra@postgresql.org>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox