pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Doc: remove bogus claim that tsvectors can have up to 2^64 entri
Date: Tue, 31 Mar 2026 15:49:59 +0000
Message-ID: <E1w7bLq-002KaL-1I@gemulon.postgresql.org> (raw)

Doc: remove bogus claim that tsvectors can have up to 2^64 entries.

This is nonsense on its face, since the textsearch parsing logic
generally uses int32 to count words (see, eg, struct ParsedText).
Not to mention that we don't support input strings larger than
1GB.

The actual limitation of interest is documented nearby: a tsvector
can't be larger than 1MB, thanks to 20-bit offset fields within it
(see WordEntry.pos).  That constrains us to well under 256K lexemes
per tsvector, depending on how many positions are stored per lexeme.

It seems sufficient therefore to just remove the bit about number
of lexemes.

Author: Dharin Shah <dharinshah95@gmail.com>
Discussion: https://postgr.es/m/CAOj6k6d0YO6AO-bhxkfUXPxUi-+YX9-doh2h5D5z0Bm8D2w=OA@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/960382e3e991f774d0ef92eb82dd7ef641f74108

Modified Files
--------------
doc/src/sgml/textsearch.sgml | 5 -----
1 file changed, 5 deletions(-)



Message-ID: <E1w7bLq-002KaL-1I@gemulon.postgresql.org>
Permalink:  ../E1w7bLq-002KaL-1I@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1w7bLq-002KaL-1I@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: tgl@sss.pgh.pa.us, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Doc: remove bogus claim that tsvectors can have up to 2^64 entri
  In-Reply-To: <E1w7bLq-002KaL-1I@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox