[Marko Tiikkaja <marko@joh.to>]

Hi,

Andres asked me on IRC to report this here.  Since we upgraded our 
standby servers to 9.1.15 (though the master is still running 9.1.14), 
we've seen the error in $SUBJECT a number of times.  I managed to 
reproduce it today by running the same query over and over again, and 
attached is the back trace.

Let me know if you need any additional information.


.m

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

Attachments:

bt.txt (text/plain, 8.7K) download
#0  GetMultiXactIdMembers (multi=56513428, xids=0x7fff9e3691e8) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/access/transam/multixact.c:923
#1  0x00007f029a917dd4 in MultiXactIdIsRunning (multi=<optimized out>) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/access/transam/multixact.c:386
#2  0x00007f029abad79d in HeapTupleSatisfiesVacuum (tuple=0x7f0145f2c060, OldestXmin=2418699920, buffer=111945) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/utils/time/tqual.c:1184
#3  0x00007f029a8f08f5 in index_getnext (scan=scan@entry=0x7f029b66ac78, direction=direction@entry=ForwardScanDirection) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/access/index/indexam.c:644
#4  0x00007f029a9fe646 in IndexNext (node=node@entry=0x7f029b669550) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeIndexscan.c:78
#5  0x00007f029a9f41dc in ExecScanFetch (recheckMtd=0x7f029a9fe5c0 <IndexRecheck>, accessMtd=0x7f029a9fe600 <IndexNext>, node=0x7f029b669550)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:82
#6  ExecScan (node=node@entry=0x7f029b669550, accessMtd=accessMtd@entry=0x7f029a9fe600 <IndexNext>, recheckMtd=recheckMtd@entry=0x7f029a9fe5c0 <IndexRecheck>)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:167
#7  0x00007f029a9fe72b in ExecIndexScan (node=node@entry=0x7f029b669550) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeIndexscan.c:146
#8  0x00007f029a9ec968 in ExecProcNode (node=node@entry=0x7f029b669550) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:398
#9  0x00007f029a9fd3e1 in MultiExecHash (node=node@entry=0x7f029b6690b0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeHash.c:103
#10 0x00007f029a9eca74 in MultiExecProcNode (node=node@entry=0x7f029b6690b0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:536
#11 0x00007f029a9fdd94 in ExecHashJoin (node=node@entry=0x7f029b667aa0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeHashjoin.c:177
#12 0x00007f029a9ec8b8 in ExecProcNode (node=node@entry=0x7f029b667aa0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:447
#13 0x00007f029a9fe319 in ExecHashJoinOuterGetTuple (hashvalue=0x7fff9e369554, hjstate=0x7f029b666c80, outerNode=0x7f029b667aa0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeHashjoin.c:656
#14 ExecHashJoin (node=node@entry=0x7f029b666c80) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeHashjoin.c:209
#15 0x00007f029a9ec8b8 in ExecProcNode (node=node@entry=0x7f029b666c80) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:447
#16 0x00007f029aa05a59 in ExecSort (node=node@entry=0x7f029b666a10) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeSort.c:103
#17 0x00007f029a9ec898 in ExecProcNode (node=node@entry=0x7f029b666a10) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:458
#18 0x00007f029aa096e0 in begin_partition (winstate=winstate@entry=0x7f029b665530) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeWindowAgg.c:683
#19 0x00007f029aa0b49b in ExecWindowAgg (winstate=winstate@entry=0x7f029b665530) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeWindowAgg.c:1287
#20 0x00007f029a9ec868 in ExecProcNode (node=0x7f029b665530) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:470
#21 0x00007f029a9f41dc in ExecScanFetch (recheckMtd=0x7f029aa084f0 <SubqueryRecheck>, accessMtd=0x7f029aa08500 <SubqueryNext>, node=0x7f029b664e60)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:82
#22 ExecScan (node=node@entry=0x7f029b664e60, accessMtd=accessMtd@entry=0x7f029aa08500 <SubqueryNext>, recheckMtd=recheckMtd@entry=0x7f029aa084f0 <SubqueryRecheck>)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:167
#23 0x00007f029aa08538 in ExecSubqueryScan (node=node@entry=0x7f029b664e60) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeSubqueryscan.c:85
#24 0x00007f029a9ec938 in ExecProcNode (node=node@entry=0x7f029b664e60) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:412
#25 0x00007f029aa05a59 in ExecSort (node=node@entry=0x7f029b664bf0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeSort.c:103
#26 0x00007f029a9ec898 in ExecProcNode (node=node@entry=0x7f029b664bf0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:458
#27 0x00007f029a9f9949 in agg_retrieve_direct (aggstate=0x7f029b590010) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeAgg.c:1058
#28 ExecAgg (node=node@entry=0x7f029b590010) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeAgg.c:1011
#29 0x00007f029a9ec878 in ExecProcNode (node=0x7f029b590010) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:466
#30 0x00007f029a9f41dc in ExecScanFetch (recheckMtd=0x7f029aa084f0 <SubqueryRecheck>, accessMtd=0x7f029aa08500 <SubqueryNext>, node=0x7f029b58f5c0)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:82
#31 ExecScan (node=node@entry=0x7f029b58f5c0, accessMtd=accessMtd@entry=0x7f029aa08500 <SubqueryNext>, recheckMtd=recheckMtd@entry=0x7f029aa084f0 <SubqueryRecheck>)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execScan.c:167
#32 0x00007f029aa08538 in ExecSubqueryScan (node=node@entry=0x7f029b58f5c0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeSubqueryscan.c:85
#33 0x00007f029a9ec938 in ExecProcNode (node=node@entry=0x7f029b58f5c0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:412
#34 0x00007f029aa05a59 in ExecSort (node=node@entry=0x7f029b58f350) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeSort.c:103
#35 0x00007f029a9ec898 in ExecProcNode (node=node@entry=0x7f029b58f350) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:458
#36 0x00007f029aa096e0 in begin_partition (winstate=winstate@entry=0x7f029b55be68) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeWindowAgg.c:683
#37 0x00007f029aa0b49b in ExecWindowAgg (winstate=winstate@entry=0x7f029b55be68) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/nodeWindowAgg.c:1287
#38 0x00007f029a9ec868 in ExecProcNode (node=node@entry=0x7f029b55be68) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execProcnode.c:470
#39 0x00007f029a9e9bc6 in ExecutePlan (dest=0x7f029b6ab9f8, direction=<optimized out>, numberTuples=0, sendTuples=1 '\001', operation=CMD_SELECT, planstate=0x7f029b55be68, estate=0x7f029b57c9a0)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execMain.c:1451
#40 standard_ExecutorRun (queryDesc=0x7f029b5c6850, direction=<optimized out>, count=0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/executor/execMain.c:325
#41 0x00007f029aac3b5f in PortalRunSelect (portal=portal@entry=0x7f029b52a360, forward=forward@entry=1 '\001', count=0, count@entry=9223372036854775807, dest=dest@entry=0x7f029b6ab9f8)
    at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/tcop/pquery.c:945
#42 0x00007f029aac512a in PortalRun (portal=portal@entry=0x7f029b52a360, count=count@entry=9223372036854775807, isTopLevel=isTopLevel@entry=1 '\001', dest=dest@entry=0x7f029b6ab9f8, 
    altdest=altdest@entry=0x7f029b6ab9f8, completionTag=completionTag@entry=0x7fff9e369fe0 "") at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/tcop/pquery.c:789
#43 0x00007f029aac0b18 in exec_simple_query (
    query_string=0x7f029b525450 ""...) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/tcop/postgres.c:1034
#44 PostgresMain (argc=<optimized out>, argv=argv@entry=0x7f029b425d78, dbname=0x7f029b425c28 "gluepay", username=<optimized out>) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/tcop/postgres.c:4021
#45 0x00007f029aa81942 in BackendRun (port=0x7f029b472610) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/postmaster/postmaster.c:3648
#46 BackendStartup (port=0x7f029b472610) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/postmaster/postmaster.c:3330
#47 ServerLoop () at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/postmaster/postmaster.c:1483
#48 0x00007f029aa8262c in PostmasterMain (argc=<optimized out>, argv=<optimized out>) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/postmaster/postmaster.c:1144
#49 0x00007f029a8ce353 in main (argc=5, argv=0x7f029b4251b0) at /tmp/buildd/postgresql-9.1-9.1.15/build/../src/backend/main/main.c:210