Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1n8cir-0000LE-8h for pgsql-hackers@arkaria.postgresql.org; Sat, 15 Jan 2022 06:39:33 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1n8cip-0005oI-Qu for pgsql-hackers@arkaria.postgresql.org; Sat, 15 Jan 2022 06:39:31 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1n8cip-0005o8-D8 for pgsql-hackers@lists.postgresql.org; Sat, 15 Jan 2022 06:39:31 +0000 Received: from mail-il1-x12e.google.com ([2607:f8b0:4864:20::12e]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1n8cil-0006f3-V7 for pgsql-hackers@postgresql.org; Sat, 15 Jan 2022 06:39:30 +0000 Received: by mail-il1-x12e.google.com with SMTP id d14so10211034ila.1 for ; Fri, 14 Jan 2022 22:39:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=4beDK5dtMf06aeRFLrLoOcRKT0ZArSBCFFwLVfvENSA=; b=tQlvjJ8UsdnRI5ZMAWn9iJANfgYXhIXflzqyn7JwBacpOlfjaUjo1wM3vgYAadK5zk Z1Vr8PH/VZUy/8ICfURkPNdZ8zfzvCk2UJYPHOOKbTkbAWR9jtLrXvMzyYAD5DmYwHlh 8kvYPlJM0YQW2WHGiTdxp4IiOGDnzYlKjh/fRGzIDz/D2zgwPn391neSMH0JgKCyqayH 31HaB4HlMp/LhcKyRLHZRKELLw/5UycdCp8KELoBYG9NzSHL8R0hp2zbvzQOKcG9TJCK aoWd8qOQfgiXkx5tqXBXPvgG5DVMvcmjo2YvfixsY8k2aBAjPVhgI+XqSyHwYzi+r8Np eeWA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=4beDK5dtMf06aeRFLrLoOcRKT0ZArSBCFFwLVfvENSA=; b=c7WaGHrJWkiSSkvulXgWjUSsk7Y+KTI74/4yENI2LwsUP8z/BumjnuIIjTSvRqqR+j pYxzQ9yQyJje9ouA7FbfzpTAbJ/GHqQuPjFGFKu6BFSqQqM6ZNG0aCJNc3UmeSm1yM5x NCwiMQd5HfTSCmCuKcRLQmnfIwMhKiZ7isAQAbr4vDk+EQe1j6ecRcMMVsIbx0SyYEml e7OXmXVx4vN4WxCAC4OEUU+FXv4db9IOTJX7+qwk9eStDgexNIRMQ+bUqPZhoxTrncXP xfz0+ucoYC3ywfuDGerpcKS0jy7DZ6gkoRB1qw8ol7Oq9QSC5fRR0L+0bgqjAmetKrxL 8TXA== X-Gm-Message-State: AOAM53314j004vybkuRirWkEv3RBAfzR26PdDMj7n7FraaUL1U8VkF2m wK8LRNkHQniqf9poRFk1RyoCtQ== X-Google-Smtp-Source: ABdhPJy9BgIZ7J+JYKumxC5x/5dEFku6Y7EoHWJhvA7N0tGcll2XzOBfHbXUDwZ3Yt9+WtbdDQZNMg== X-Received: by 2002:a05:6e02:1c25:: with SMTP id m5mr6518346ilh.251.1642228767212; Fri, 14 Jan 2022 22:39:27 -0800 (PST) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id g11sm5462988ild.52.2022.01.14.22.39.26 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 14 Jan 2022 22:39:26 -0800 (PST) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id C077B803B19; Sat, 15 Jan 2022 00:39:25 -0600 (CST) Date: Sat, 15 Jan 2022 00:39:25 -0600 From: Justin Pryzby To: Maxim Orlov Cc: pgsql-hackers@postgresql.org, Pavel Borisov , Alexander Korotkov , Teodor Sigaev , Nikita Glukhov , Konstantin Knizhnik , Yura Sokolov Subject: Re: Add 64-bit XIDs into PostgreSQL 15 Message-ID: <20220115063925.GS14051@telsasoft.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk I tried to pg_upgrade from a v13 instance like: time make check -C src/bin/pg_upgrade oldsrc=`pwd`/13 oldbindir=`pwd`/13/tmp_install/usr/local/pgsql/bin I had compiled and installed v13 into `pwd`/13. First, test.sh failed, because of an option in initdb which doesn't exist in the old version: -x 21000000000 I patched test.sh so the option is used only the "new" version. The tab_core_types table has an XID column, so pg_upgrade --check complains and refuses to run. If I drop it, then pg_upgrade runs, but then fails like this: |Files /home/pryzbyj/src/postgres/src/bin/pg_upgrade/tmp_check/new_xids.txt and /home/pryzbyj/src/postgres/src/bin/pg_upgrade/tmp_check/old_xids.txt differ |See /home/pryzbyj/src/postgres/src/bin/pg_upgrade/tmp_check/xids.diff | |--- /home/pryzbyj/src/postgres/src/bin/pg_upgrade/tmp_check/new_xids.txt 2022-01-15 00:14:23.035294414 -0600 |+++ /home/pryzbyj/src/postgres/src/bin/pg_upgrade/tmp_check/old_xids.txt 2022-01-15 00:13:59.634945012 -0600 |@@ -1,5 +1,5 @@ | relfrozenxid | relminmxid | --------------+------------ |- 3 | 3 |+ 15594 | 3 | (1 row) Also, the patch needs to be rebased over Peter's vacuum changes. Here's the changes I used for my test: diff --git a/src/bin/pg_upgrade/test.sh b/src/bin/pg_upgrade/test.sh index c6361e3c085..5eae42192b6 100644 --- a/src/bin/pg_upgrade/test.sh +++ b/src/bin/pg_upgrade/test.sh @@ -24,7 +24,8 @@ standard_initdb() { # without increasing test runtime, run these tests with a custom setting. # Also, specify "-A trust" explicitly to suppress initdb's warning. # --allow-group-access and --wal-segsize have been added in v11. - "$1" -N --wal-segsize 1 --allow-group-access -A trust -x 21000000000 + "$@" -N --wal-segsize 1 --allow-group-access -A trust + if [ -n "$TEMP_CONFIG" -a -r "$TEMP_CONFIG" ] then cat "$TEMP_CONFIG" >> "$PGDATA/postgresql.conf" @@ -237,7 +238,7 @@ fi PGDATA="$BASE_PGDATA" -standard_initdb 'initdb' +standard_initdb 'initdb' -x 21000000000 pg_upgrade $PG_UPGRADE_OPTS --no-sync -d "${PGDATA}.old" -D "$PGDATA" -b "$oldbindir" -p "$PGPORT" -P "$PGPORT" diff --git a/src/bin/pg_upgrade/upgrade_adapt.sql b/src/bin/pg_upgrade/upgrade_adapt.sql index 27c4c7fd011..c5ce8bc95b2 100644 --- a/src/bin/pg_upgrade/upgrade_adapt.sql +++ b/src/bin/pg_upgrade/upgrade_adapt.sql @@ -89,3 +89,5 @@ DROP OPERATOR public.#%# (pg_catalog.int8, NONE); DROP OPERATOR public.!=- (pg_catalog.int8, NONE); DROP OPERATOR public.#@%# (pg_catalog.int8, NONE); \endif + +DROP TABLE IF EXISTS tab_core_types;