public inbox for [email protected]  
help / color / mirror / Atom feed
From: =?gb18030?B?endq?= <[email protected]>
To: =?gb18030?B?RGVhbiBSYXNoZWVk?= <[email protected]>
To: =?gb18030?B?amlhbiBoZQ==?= <[email protected]>
To: =?gb18030?B?VG9tIExhbmU=?= <[email protected]>
Cc: =?gb18030?B?cGdzcWwtaGFja2Vycw==?= <[email protected]>
Subject: =?gb18030?B?u9i4tKO6IGJ1ZyByZXBvcnQ6IHNvbWUgaXNzdWVz?= =?gb18030?B?IGFib3V0IHBnXzE1X3N0YWJsZSg4ZmE0YTFhYzYx?= =?gb18030?B?MTg5ZWZmZmI4Yjg1MWVlNzdlMWJjODczNjBjNDQ1?= =?gb18030?B?KQ==?=
Date: Tue, 5 Mar 2024 18:04:33 +0800
Message-ID: <[email protected]> (raw)
In-Reply-To: <CACJufxFfbDhKiNHs8+pnZcZMtOHiANcXzV=JG_Qf=bhi6=vL7w@mail.gmail.com>
References: <[email protected]>
	<CAEZATCUyvLVU1bon7E5LExR+YFjFm1AJbGdrkVXx5oVB_LVE3g@mail.gmail.com>
	<CAEZATCWPByO0ovyV_fU+hy5vDu=d+JW3GLdBF_S4zrfADBGvYQ@mail.gmail.com>
	<[email protected]>
	<[email protected]>
	<CAEZATCVa-mgPuOdgd8+YVgOJ4wgJuhT2mJznbj_tmsGAP8hHJw@mail.gmail.com>
	<CACJufxEYuCnGUUymGXu-V742OE2+BGx18-znHnWkCuN+gN19eA@mail.gmail.com>
	<CAEZATCUs17W0O78=LLnZSAuN2vq2myxuOtMFgkMsYR-JKHRmSA@mail.gmail.com>
	<CACJufxFfbDhKiNHs8+pnZcZMtOHiANcXzV=JG_Qf=bhi6=vL7w@mail.gmail.com>

Hi,hackers
&nbsp;
&nbsp;I may have discovered another issue in the concurrency scenario of merge,&nbsp; and I am currently not sure if this new issue is related to the previous one.&nbsp;
&nbsp;It seems that it may also be an issue with the EPQ mechanism in the merge scenario?&nbsp;
&nbsp;I will provide this test case, hoping it will be helpful for you to fix related issues in the future.



&nbsp;&nbsp;&nbsp; DROP TABLE IF EXISTS src1, tgt;
&nbsp;&nbsp;&nbsp; CREATE TABLE src1 (a int, b text);
&nbsp;&nbsp;&nbsp; CREATE TABLE tgt (a int, b text);
&nbsp;&nbsp;&nbsp; INSERT INTO src1 SELECT x, 'Src1 '||x FROM generate_series(1, 3) g(x);
&nbsp;&nbsp;&nbsp; INSERT INTO tgt SELECT x, 'Tgt '||x FROM generate_series(1, 6, 2) g(x);
&nbsp;&nbsp;&nbsp; insert into src1 values(3,'src1 33');



&nbsp;If I only execute merge , I will get the following error:
&nbsp;&nbsp;&nbsp; merge into tgt a using src1 c on&nbsp; a.a = c.a when matched then update set b = c.b when not matched then insert (a,b) values(c.a,c.b);&nbsp; -- excute fail
&nbsp;&nbsp;&nbsp; ERROR:&nbsp; MERGE command cannot affect row a second time
&nbsp;&nbsp;&nbsp; HIINT:&nbsp; Ensure that not more than one source row matches any one target row.



&nbsp;But when I execute the update and merge concurrently, I will get the following result set.

&nbsp; --session1
&nbsp;&nbsp;&nbsp; begin;

&nbsp;&nbsp;&nbsp; update tgt set b = 'tgt333' where a =3;

&nbsp; --session2
&nbsp;&nbsp;&nbsp; merge into tgt a using src1 c on&nbsp; a.a = c.a when matched then update set  b = c.b when not matched then insert (a,b) values(c.a,c.b);&nbsp; -- excute success
&nbsp; --session1
&nbsp;&nbsp;&nbsp; commit;
&nbsp;&nbsp;&nbsp; select * from tgt;
&nbsp;&nbsp; &nbsp; a |&nbsp;&nbsp;&nbsp; b&nbsp;&nbsp; &nbsp;
&nbsp;&nbsp;&nbsp; ---+---------
&nbsp;&nbsp;&nbsp;&nbsp; 5 | Tgt 5
&nbsp;&nbsp;&nbsp;&nbsp; 1 | Src1 1
&nbsp;&nbsp;&nbsp;&nbsp; 2 | Src1 2
&nbsp;&nbsp;&nbsp;&nbsp; 3 | Src1 3
&nbsp;&nbsp;&nbsp;&nbsp; 3 | src1 33

&nbsp; I think even if the tuple with id:3 is udpated, merge should still be able to retrieve new tuples with id:3,&nbsp; and&nbsp;report the same error as above?


Regards,
wenjiang zhang


------------------&nbsp;原始邮件&nbsp;------------------
发件人:                                                                                                                        "jian he"                                                                                    <[email protected]&gt;;
发送时间:&nbsp;2024年2月29日(星期四) 中午11:04
收件人:&nbsp;"Dean Rasheed"<[email protected]&gt;;
抄送:&nbsp;"Tom Lane"<[email protected]&gt;;"zwj"<[email protected]&gt;;"pgsql-hackers"<[email protected]&gt;;
主题:&nbsp;Re: bug report: some issues about pg_15_stable(8fa4a1ac61189efffb8b851ee77e1bc87360c445)



On Wed, Feb 28, 2024 at 8:11 PM Dean Rasheed <[email protected]&gt; wrote:
&gt;
&gt; On Wed, 28 Feb 2024 at 09:16, jian he <[email protected]&gt; wrote:
&gt; &gt;
&gt; &gt; + oldcontext = MemoryContextSwitchTo(estate-&gt;es_query_cxt);
&gt; &gt; +
&gt; &gt; + node-&gt;as_epq_tupdesc = lookup_rowtype_tupdesc_copy(tupType, tupTypmod);
&gt; &gt; +
&gt; &gt; + ExecAssignExprContext(estate, &amp;node-&gt;ps);
&gt; &gt; +
&gt; &gt; + node-&gt;ps.ps_ProjInfo =
&gt; &gt; + ExecBuildProjectionInfo(castNode(Append, node-&gt;ps.plan)-&gt;epq_targetlist,
&gt; &gt; +
&gt; &gt; EvalPlanQualStart, EvalPlanQualNext will switch the memory context to
&gt; &gt; es_query_cxt.
&gt; &gt; so the memory context switch here is not necessary?
&gt; &gt;
&gt;
&gt; Yes it is necessary. The EvalPlanQual mechanism switches to the
&gt; epqstate-&gt;recheckestate-&gt;es_query_cxt memory context, which is not the
&gt; same as the main query's estate-&gt;es_query_cxt (they're different
&gt; executor states). Most stuff allocated under EvalPlanQual() is
&gt; intended to be short-lived (just for the duration of that specific EPQ
&gt; check), whereas this stuff (the TupleDesc and Projection) is intended
&gt; to last for the duration of the main query, so that it can be reused
&gt; in later EPQ checks.
&gt;
sorry for the noise. I understand it now.

Another small question:
for the Append case, we can set/initialize it at create_append_plan,
all other elements are initialized there,
why we set it at set_append_references.
just wondering.

view thread (6+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected], [email protected]
  Subject: Re: =?gb18030?B?u9i4tKO6IGJ1ZyByZXBvcnQ6IHNvbWUgaXNzdWVz?= =?gb18030?B?IGFib3V0IHBnXzE1X3N0YWJsZSg4ZmE0YTFhYzYx?= =?gb18030?B?MTg5ZWZmZmI4Yjg1MWVlNzdlMWJjODczNjBjNDQ1?= =?gb18030?B?KQ==?=
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox