Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u6tV1-007D6U-B0 for pgsql-hackers@arkaria.postgresql.org; Mon, 21 Apr 2025 15:55:59 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1u6tUz-006VVT-GB for pgsql-hackers@arkaria.postgresql.org; Mon, 21 Apr 2025 15:55:58 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1u6tUy-006VVE-Ul for pgsql-hackers@lists.postgresql.org; Mon, 21 Apr 2025 15:55:57 +0000 Received: from mail-il1-x12f.google.com ([2607:f8b0:4864:20::12f]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1u6tUx-001CdW-1N for pgsql-hackers@lists.postgresql.org; Mon, 21 Apr 2025 15:55:56 +0000 Received: by mail-il1-x12f.google.com with SMTP id e9e14a558f8ab-3d5e43e4725so8338445ab.1 for ; Mon, 21 Apr 2025 08:55:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1745250955; x=1745855755; darn=lists.postgresql.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=KdsLgWvJ2fh56gjJtCmOWlptkwqmFyTO4pxRet+9IV0=; b=JV14GeHrr0F2Ro+FJPn/zVzRDBLryp8HI/7qdp9xjEeKE14xk7Y3ODKtf/cOHrJAjl hhpEPrUmF2fZoYNPiLtb5PHhT9TNTUiF/iAR1Q0+BCWsqTQsHtkmNND+yyvQtjK2uY7N cT2CXcpjdRqQ+oeVK0VCoQJD+iB8vorttuwJ7BeGWMx3+AjB3wXL18uspmCwSy7mQm4R SgtWVdcX+L3urZfJnkZK/FboQ4GL2pwGbyKxFHHHC0N+YCYS+W2nLR4S/Q5qG6y42XnK bItJqdJ+NqwhTFvLOInkhRidXUElzj5uC61ZCv1otFqwot3f9EBYjZcvzHpRA96LYcyo 3gWQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1745250955; x=1745855755; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=KdsLgWvJ2fh56gjJtCmOWlptkwqmFyTO4pxRet+9IV0=; b=WwiJtm1VKuK3uZlXS6WOjPyP4jHaVkp8oDCdAHo2d388Z2hZOe1w1F/ZSfQNLabt/q J8OGA85d/oyufEn3Rj7Y5w2I78q1a9ffxo+DaUIaKYGA/8kUbjt7auFOZ8IsR8DnlNz9 DVh/JHkHE4g55aTygJ7CDGuXQ8TRTSK6VyD3JFS0mW3U7vYZdcGWg30po0xVeMyRx+Yc qSqxo2dejjqksoVCaio3+Rek0fj/P6g58AIj9QE7w0NlKF0cAxIYq9ae3ydtxbhTgRW8 o28xUqTUlD91MO0lQRwbXSvi61AuOseF9Dz9adzGAMK1w+KQxlzFJhSjMY4+VDT2caws nzLA== X-Forwarded-Encrypted: i=1; AJvYcCXtEiigi2fRHnXicH4dkg4BFsFxHH1kfmduIs2BkdM0Qz4LcKgNWuFJ6wfrP4DpHOKVDlErYOj3ritm6ou6@lists.postgresql.org X-Gm-Message-State: AOJu0YxWeGLSDIjsjFHJJlKArQZ6W4crZrh6r+kD0KEaPRec4BeeEcob +Ww/TuDMl8k4G5z1WSl6u+KXs46HXYNlp+AiTs17ybih8aaqksNw X-Gm-Gg: ASbGnctFLVbg5Ntd+TZ5MMcUDWlJasqamj3u9ZLmqf5GprLqVjWTte63juX9ECbFsbE VMhjxdmMI6grpQ54Xvkr/QysFxkeHzq1Vzsnx3qFXzUn+a354Rn5I4umPxVud8Vgy68PiOjI+ac u7dWIUMl9j6lKPSB3GIJ5Jjb1MGmVjmv2lHSXxw0tVTVuObb8SxDVNJVV6sUsVw74Nqqs/ZgMtO Jh16oD54UfeHLDHB9TrMDBWaiVsmnPSVR1WNEkHZKWaTuLKwdkj1/AqFG9H/HPiVRJtkUHe4sJs HvY+3YMC7lejeMsWcFRo5bljXT4lupGAlSjJ4rNYKnRxK30gEvv9Rg+lO8hwVA88zV3PAygsLEt r47SH+nfNg4XAP390QfO/NaCjsdj2ENg5O/w+f816rg== X-Google-Smtp-Source: AGHT+IHPmyRs+eR1ZxGEzLY4NZSoAl2el8RtwswI6Hb/E3gJwzKQItm0wC8ZWXdrgypE0ycEGBOdKw== X-Received: by 2002:a05:6e02:214f:b0:3d8:1b0b:c92b with SMTP id e9e14a558f8ab-3d88ed7c360mr121312385ab.2.1745250955043; Mon, 21 Apr 2025 08:55:55 -0700 (PDT) Received: from nathan (162-195-168-172.lightspeed.stlsmo.sbcglobal.net. [162.195.168.172]) by smtp.gmail.com with ESMTPSA id 8926c6da1cb9f-4f6a3933c44sm1760898173.100.2025.04.21.08.55.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 21 Apr 2025 08:55:53 -0700 (PDT) Date: Mon, 21 Apr 2025 10:55:52 -0500 From: Nathan Bossart To: Euler Taveira Cc: Michael Paquier , Amit Kapila , Alexander Lakhin , Tom Lane , "Jonathan S. Katz" , PostgreSQL Hackers Subject: Re: Large expressions in indexes can't be stored (non-TOASTable) Message-ID: References: <4c2a6100-738e-48cc-8a11-2d85f95ae0ed@app.fastmail.com> <18a111db-9f31-449c-a14b-61779a69f344@app.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="bTDwjIUeF//Yo3V5" Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --bTDwjIUeF//Yo3V5 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Apparently replication origins in tests are supposed to be prefixed with "regress_". Here is a new patch with that fixed. -- nathan --bTDwjIUeF//Yo3V5 Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="v3-0001-Remove-pg_replication_origin-s-TOAST-table.patch" From fa6a8a5a155a7beb50e54bfe42c81be26ffd428a Mon Sep 17 00:00:00 2001 From: Nathan Bossart Date: Mon, 21 Apr 2025 10:53:15 -0500 Subject: [PATCH v3 1/1] Remove pg_replication_origin's TOAST table. --- doc/src/sgml/func.sgml | 1 + src/backend/catalog/catalog.c | 2 -- src/backend/replication/logical/origin.c | 12 ++++++++++++ src/include/catalog/pg_replication_origin.h | 2 -- src/include/replication/origin.h | 7 +++++++ src/test/regress/expected/misc_functions.out | 4 ++++ src/test/regress/expected/misc_sanity.out | 6 +++++- src/test/regress/sql/misc_functions.sql | 3 +++ src/test/regress/sql/misc_sanity.sql | 3 +++ 9 files changed, 35 insertions(+), 5 deletions(-) diff --git a/doc/src/sgml/func.sgml b/doc/src/sgml/func.sgml index 574a544d9fa..593e45495be 100644 --- a/doc/src/sgml/func.sgml +++ b/doc/src/sgml/func.sgml @@ -29941,6 +29941,7 @@ postgres=# SELECT '0/0'::pg_lsn + pd.segment_number * ps.setting::int + :offset Creates a replication origin with the given external name, and returns the internal ID assigned to it. + The name must be no longer than 512 bytes. diff --git a/src/backend/catalog/catalog.c b/src/backend/catalog/catalog.c index 60000bd0bc7..59caae8f1bc 100644 --- a/src/backend/catalog/catalog.c +++ b/src/backend/catalog/catalog.c @@ -346,8 +346,6 @@ IsSharedRelation(Oid relationId) relationId == PgDbRoleSettingToastIndex || relationId == PgParameterAclToastTable || relationId == PgParameterAclToastIndex || - relationId == PgReplicationOriginToastTable || - relationId == PgReplicationOriginToastIndex || relationId == PgShdescriptionToastTable || relationId == PgShdescriptionToastIndex || relationId == PgShseclabelToastTable || diff --git a/src/backend/replication/logical/origin.c b/src/backend/replication/logical/origin.c index 6583dd497da..c17c0348c6e 100644 --- a/src/backend/replication/logical/origin.c +++ b/src/backend/replication/logical/origin.c @@ -264,6 +264,18 @@ replorigin_create(const char *roname) SysScanDesc scan; ScanKeyData key; + /* + * To avoid needing a TOAST table for pg_replication_origin, we restrict + * replication origin names to 512 bytes. This should be more than enough + * for all practical use. + */ + if (strlen(roname) > MAX_RONAME_LEN) + ereport(ERROR, + (errcode(ERRCODE_PROGRAM_LIMIT_EXCEEDED), + errmsg("replication origin name is too long"), + errdetail("Replication origin names must be no longer than %d bytes.", + MAX_RONAME_LEN))); + roname_d = CStringGetTextDatum(roname); Assert(IsTransactionState()); diff --git a/src/include/catalog/pg_replication_origin.h b/src/include/catalog/pg_replication_origin.h index deb43065fe9..7ade8bbda39 100644 --- a/src/include/catalog/pg_replication_origin.h +++ b/src/include/catalog/pg_replication_origin.h @@ -54,8 +54,6 @@ CATALOG(pg_replication_origin,6000,ReplicationOriginRelationId) BKI_SHARED_RELAT typedef FormData_pg_replication_origin *Form_pg_replication_origin; -DECLARE_TOAST_WITH_MACRO(pg_replication_origin, 4181, 4182, PgReplicationOriginToastTable, PgReplicationOriginToastIndex); - DECLARE_UNIQUE_INDEX_PKEY(pg_replication_origin_roiident_index, 6001, ReplicationOriginIdentIndex, pg_replication_origin, btree(roident oid_ops)); DECLARE_UNIQUE_INDEX(pg_replication_origin_roname_index, 6002, ReplicationOriginNameIndex, pg_replication_origin, btree(roname text_ops)); diff --git a/src/include/replication/origin.h b/src/include/replication/origin.h index 9cb2248fa9f..29724c0dcae 100644 --- a/src/include/replication/origin.h +++ b/src/include/replication/origin.h @@ -33,6 +33,13 @@ typedef struct xl_replorigin_drop #define InvalidRepOriginId 0 #define DoNotReplicateId PG_UINT16_MAX +/* + * To avoid needing a TOAST table for pg_replication_origin, we restrict + * replication origin names to 512 bytes. This should be more than enough for + * all practical use. + */ +#define MAX_RONAME_LEN 512 + extern PGDLLIMPORT RepOriginId replorigin_session_origin; extern PGDLLIMPORT XLogRecPtr replorigin_session_origin_lsn; extern PGDLLIMPORT TimestampTz replorigin_session_origin_timestamp; diff --git a/src/test/regress/expected/misc_functions.out b/src/test/regress/expected/misc_functions.out index d3f5d16a672..3de32c3c7ef 100644 --- a/src/test/regress/expected/misc_functions.out +++ b/src/test/regress/expected/misc_functions.out @@ -914,3 +914,7 @@ SELECT test_relpath(); (1 row) +-- pg_replication_origin.roname length restriction +SELECT pg_replication_origin_create('regress_' || repeat('a', 505)); +ERROR: replication origin name is too long +DETAIL: Replication origin names must be no longer than 512 bytes. diff --git a/src/test/regress/expected/misc_sanity.out b/src/test/regress/expected/misc_sanity.out index b032a3f4761..0cb58311329 100644 --- a/src/test/regress/expected/misc_sanity.out +++ b/src/test/regress/expected/misc_sanity.out @@ -42,6 +42,9 @@ WHERE refclassid = 0 OR refobjid = 0 OR -- as user data by pg_upgrade, which would cause failures. -- 3. pg_authid, since its toast table cannot be accessed when it would be -- needed, i.e., during authentication before we've selected a database. +-- 4. pg_replication_origin, since its toast table would only be used for +-- replication origin names, which we can avoid with a reasonable length +-- restriction. SELECT relname, attname, atttypid::regtype FROM pg_class c JOIN pg_attribute a ON c.oid = attrelid WHERE c.oid < 16384 AND @@ -61,7 +64,8 @@ ORDER BY 1, 2; pg_class | relpartbound | pg_node_tree pg_largeobject | data | bytea pg_largeobject_metadata | lomacl | aclitem[] -(10 rows) + pg_replication_origin | roname | text +(11 rows) -- system catalogs without primary keys -- diff --git a/src/test/regress/sql/misc_functions.sql b/src/test/regress/sql/misc_functions.sql index aaebb298330..ea72a62dab7 100644 --- a/src/test/regress/sql/misc_functions.sql +++ b/src/test/regress/sql/misc_functions.sql @@ -411,3 +411,6 @@ CREATE FUNCTION test_relpath() AS :'regresslib' LANGUAGE C; SELECT test_relpath(); + +-- pg_replication_origin.roname length restriction +SELECT pg_replication_origin_create('regress_' || repeat('a', 505)); diff --git a/src/test/regress/sql/misc_sanity.sql b/src/test/regress/sql/misc_sanity.sql index 135793871b4..545b2b48989 100644 --- a/src/test/regress/sql/misc_sanity.sql +++ b/src/test/regress/sql/misc_sanity.sql @@ -45,6 +45,9 @@ WHERE refclassid = 0 OR refobjid = 0 OR -- as user data by pg_upgrade, which would cause failures. -- 3. pg_authid, since its toast table cannot be accessed when it would be -- needed, i.e., during authentication before we've selected a database. +-- 4. pg_replication_origin, since its toast table would only be used for +-- replication origin names, which we can avoid with a reasonable length +-- restriction. SELECT relname, attname, atttypid::regtype FROM pg_class c JOIN pg_attribute a ON c.oid = attrelid -- 2.39.5 (Apple Git-154) --bTDwjIUeF//Yo3V5--