Date: Sat, 30 Oct 2021 12:19:19 -0700
From: Noah Misch <noah@leadboat.com>
To: Sandeep Thakkar <sandeep.thakkar@enterprisedb.com>
Cc: Andrey Borodin <x4mmm@yandex-team.ru>, CM Team <cm@enterprisedb.com>,
	PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>,
	Michael Paquier <michael@paquier.xyz>, Tom Lane <tgl@sss.pgh.pa.us>,
	Peter Geoghegan <pg@bowt.ie>, Andres Freund <andres@anarazel.de>
Subject: Re: CREATE INDEX CONCURRENTLY does not index prepared xact's data
Message-ID: <20211030191919.GA355663@rfd.leadboat.com>
References: <20211017151205.GA2384251@rfd.leadboat.com>
 <9BA43784-E4A7-4638-900C-FC9868C388FA@yandex-team.ru>
 <20211019030212.GB3403374@rfd.leadboat.com>
 <20211024050028.GA3310519@rfd.leadboat.com>
 <20211024233502.GA3960658@rfd.leadboat.com>
 <20211028140459.GA284584@rfd.leadboat.com>
 <CANFyU942Dc=jVespMAJm=urAZb3mXc70MKkqFt8ZdKLgxyizqw@mail.gmail.com>
 <6EA60326-3CDF-4433-A190-F6D94A4B2ED5@yandex-team.ru>
 <CANFyU95S6C2q=eByr=8ocd4BJkgesYUTd7n4OsFzJ_t611NdWQ@mail.gmail.com>
 <CANFyU94A1kO4TKB4PODGYUqDRvPnBmc=P=EJR6_VxoFLiRjEMw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
In-Reply-To: 
 <CANFyU94A1kO4TKB4PODGYUqDRvPnBmc=P=EJR6_VxoFLiRjEMw@mail.gmail.com>
User-Agent: Mutt/1.5.24 (2015-08-30)
Archived-At: 
 <https://www.postgresql.org/message-id/20211030191919.GA355663%40rfd.leadboat.com>
Precedence: bulk

On Sat, Oct 30, 2021 at 01:44:56PM +0530, Sandeep Thakkar wrote:
> On Sat, Oct 30, 2021 at 1:29 PM Sandeep Thakkar <sandeep.thakkar@enterpri=
sedb.com> wrote:
> > On Sat, Oct 30, 2021 at 12:56 PM Andrey Borodin <x4mmm@yandex-team.ru> =
wrote:
> >> Some failed runs on this animal indicate SegFault in places changed by
> >> bugfix relevant to this thread. Fails were observed only on HEAD, but =
this
> >> may be a result of concurrent nature of possible new bug. If there is =
a new
> >> bug - this would affect upcoming point release. But we do not know for
> >> sure. Other animals show no signs of any related SegFault.
> >> Can you please run make check phase on this animal on HEAD multiple ti=
me
> >> (preferably ~hundred times)? If some of this runs fail it's vital to
> >> collect backtraces of run.
> >
> > OK I got it now. I've scheduled "./run_build.pl HEAD" on this animal to
> > run multiple times in a day. Unfortunately, I can't run it ~100 times
> > because it's a legacy (slow) server and also we run another animal (ano=
le -
> > with a different compiler) on the same server. Depending on the time ev=
ery
> > run on HEAD takes, I'll increase the frequency. Hope this helps.
>
> I've used "--force" option so that it ignores the last running status.
> ./run_build.pl --verbose --force HEAD

Thanks, but I don't think that gets us closer to having a stack trace for t=
he
SIGSEGV.  If some run gets a SIGSEGV, the core dump will get unlinked.  I'd
disable both buildfarm member cron jobs and then run this script (derived f=
rom
gharial's buildfarm configuration):

git clone https://git.postgresql.org/git/postgresql.git
cd postgresql
git checkout 70bef49
export LD_LIBRARY_PATH=3D'/opt/uuid-1.6.2/inst/lib:/opt/packages/uuid-1.6.2=
/inst/lib:/opt/packages/krb5-1.11.3/inst/lib/hpux64:/opt/packages/libmemcac=
hed-0.46/inst/lib/hpux64:/opt/packages/libevent-2.0.10/inst/lib/hpux64:/opt=
/packages/expat-2.0.1/inst/lib/hpux64:/opt/packages/gdbm-1.8.3/inst/lib/hpu=
x64:/opt/packages/openldap-2.4.24/inst/lib/hpux64:/opt/packages/proj-4.7.0/=
inst/lib:/opt/packages/geos-3.2.2/inst/lib:/opt/packages/db-5.1.19/inst/lib=
/hpux64:/opt/packages/freetype-2.4.4/inst/lib/hpux64:/opt/packages/tcltk-8.=
5.9/inst/lib/hpux64:/opt/packages/openssl-1.0.0d/inst/lib/hpux64:/opt/packa=
ges/editline-2.9/inst/lib/hpux64:/opt/packages/mutt-1.5.21/inst/lib/hpux64:=
/opt/packages/libidn-1.20/inst/lib/hpux64:/opt/packages/libxslt-1.1.26/inst=
/lib/hpux64:/opt/packages/libgcrypt-1.4.6/inst/lib/hpux64:/opt/packages/lib=
gpg_error-1.10/inst/lib/hpux64:/opt/packages/libxml2-2.7.8/inst/lib/hpux64:=
/opt/packages/zlib-1.2.5/inst/lib/hpux64:/opt/packages/grep-2.7/inst/lib/hp=
ux64:/opt/packages/pcre-8.12/inst/lib/hpux64:/opt/packages/ncurses-5.8/inst=
/lib/hpux64:/opt/packages/termcap-1.3.1/inst/lib/hpux64:/opt/packages/gette=
xt-0.18.1.1/inst/lib/hpux64:/opt/packages/libiconv-1.13.1/inst/lib/hpux64:/=
opt/packages/sdk-10.2.0.5.0-hpux-ia64/instantclient_10_2/lib'
cat >temp.conf <<EOF
log_line_prefix =3D '%m [%p:%l] %q%a '
log_connections =3D 'true'
log_disconnections =3D 'true'
log_statement =3D 'all'
fsync =3D off
force_parallel_mode =3D regress
EOF
=2E/configure --enable-cassert --enable-debug --with-perl --without-readlin=
e \
        --with-libxml --with-libxslt --with-libs=3D/opt/packages/zlib-1.2.5=
/inst/lib/hpux64:/opt/packages/libxslt-1.1.26/inst/lib/hpux64:/opt/packages=
/libxml2-2.7.8/inst/lib/hpux64 \
        --with-includes=3D/opt/packages/zlib-1.2.5/inst/include:/opt/packag=
es/libxslt-1.1.26/inst/include:/opt/packages/libxml2-2.7.8/inst/include \
        --with-pgport=3D5678 CFLAGS=3D-mlp64 CC=3Dgcc
make
while make check TEMP_CONFIG=3D$PWD/temp.conf NO_LOCALE=3D1; do :; done
# When the loop stops, use the core file to make a stack trace.  If it runs
# for a week without stopping, give up.