Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t3Ua9-00CqkD-AZ for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Oct 2024 06:10:58 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1t3Ua7-006fbw-Ct for pgsql-hackers@arkaria.postgresql.org; Wed, 23 Oct 2024 06:10:55 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t3Ua5-006fbo-KH for pgsql-hackers@lists.postgresql.org; Wed, 23 Oct 2024 06:10:55 +0000 Received: from fhigh-a1-smtp.messagingengine.com ([103.168.172.152]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1t3Ua1-002Vyq-3R for pgsql-hackers@postgresql.org; Wed, 23 Oct 2024 06:10:53 +0000 Received: from phl-compute-07.internal (phl-compute-07.phl.internal [10.202.2.47]) by mailfhigh.phl.internal (Postfix) with ESMTP id 7694F11401AC; Wed, 23 Oct 2024 02:10:46 -0400 (EDT) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-07.internal (MEProxy); Wed, 23 Oct 2024 02:10:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=paquier.xyz; h= cc:cc:content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729663846; x=1729750246; bh=/IJMda43O2 R2a0yH+padqkZm3oe+yIVuRAvx5B8UWAw=; b=DADzuyqLDjye8dZ9RMcsc+bfEb L45g9gxrTxEYR/1pIu/++ZHKdJjK8vIFwXYLvy2ENrndM7svNy0KERSsZZ9Sah4Z AmJ5KA5SOCWUWRddbCPJOxYrF3fKC+RpYBeg0I0+9A+v6iZ5MZWaplmn+12TgPHd +pPWubmPO36kDb65javMevdNMDsYxeJXYPsrtjluwvdeOYB3r9FGoG2VeMZkFQGj JxuT245Z1YxfQkonJWBw7vgZFlDEut6IxNZYU7g5bP+6+MrC/0iGHdYu1HR/zvq0 g0rddx7FONbf8aSZNltkvRWyGRsHsozTWNPlQn+FbbtwXJeEbfbfncUwqQcw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729663846; x=1729750246; bh=/IJMda43O2R2a0yH+padqkZm3oe+ yIVuRAvx5B8UWAw=; b=eMVXGzMGzBK4GZMo6Mxk+Je8mo2Vv07oyOqfghBV8bjO HLpJakjQqCivYfPA5OLOk0aRo2ntgmvle0l9L4Ssr/hvg9pP4DDe1JgSbdJmDkZJ 5PpO83cb7HumYcR/TjARboOa18KuEIUx6Lvah2GEllxtpQlz62MOmONwnP/0kwm5 JyeS47VUlJ2Fp+XadXceLoLm8yOGNM9bwcyaYFFKc3BNEAyQbmaU2y7mlb2+VRXA gusnWgfTIihPtWBJi0A+Pxw42PjpJtMiefaw9abytm6Z32cS54vaVRcf6TuXEdO9 Xry9TpthRkMF8c8tTr5eSKEVh+hQpTfHiNjr2aey0w== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeiiedguddtfecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdp uffrtefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivg hnthhsucdlqddutddtmdenfghrlhcuvffnffculdejtddmnecujfgurhepfffhvfevuffk fhggtggujgesghdtreertddtjeenucfhrhhomhepofhitghhrggvlhcurfgrqhhuihgvrh cuoehmihgthhgrvghlsehprghquhhivghrrdighiiiqeenucggtffrrghtthgvrhhnpeev teejgfejveegudekheeiueeiueeiveeuiedugeehveeugffgudeuleegleeiteenucevlh hushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehmihgthhgrvghl sehprghquhhivghrrdighiiipdhnsggprhgtphhtthhopeefpdhmohguvgepshhmthhpoh huthdprhgtphhtthhopegrnhhthhhonhhinhdrsghonhhnvghfohihsegurghtrgguohhg hhhqrdgtohhmpdhrtghpthhtohepjhhirghnrdhunhhivhgvrhhsrghlihhthiesghhmrg hilhdrtghomhdprhgtphhtthhopehpghhsqhhlqdhhrggtkhgvrhhssehpohhsthhgrhgv shhqlhdrohhrgh X-ME-Proxy: Feedback-ID: i0fe9450f:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 23 Oct 2024 02:10:44 -0400 (EDT) Date: Wed, 23 Oct 2024 15:10:19 +0900 From: Michael Paquier To: Anthonin Bonnefoy Cc: jian he , PostgreSQL Hackers Subject: Re: Set query_id for query contained in utility statement Message-ID: References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="0g6SVKqrytYIJkee" Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --0g6SVKqrytYIJkee Content-Type: multipart/mixed; boundary="VgCCNXyoan5DuLqB" Content-Disposition: inline --VgCCNXyoan5DuLqB Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 22, 2024 at 11:34:55AM +0200, Anthonin Bonnefoy wrote: > On Tue, Oct 22, 2024 at 7:06=E2=80=AFAM Michael Paquier wrote: >> Something that >> worries me a bit is that this changes makes the code less clean, by >> having a SELECT-INTO specific routine called in the parse-analyze >> paths, while adding three individual paths in charge of setting >> pstate->p_stmt_len and p_stmt_location. >=20 > I've moved pstate's p_stmt_len and p_stmt_location assignment to > transformTopLevelStmt (and also restored transformTopLevelStmt). This > will remove the multiple assignment paths. >=20 >> + n->stmt_len =3D @3 - @2; >> >> This specific case deserves a comment. >=20 > I think I went over this 3 times thinking "maybe I should add a > comment here". Added. Thanks. These changes look OK. > This is doable. I've moved the query's location and length assignment > to the end of transformStmt which will call setQueryLocationAndLength. > The logic of manipulating locations and lengths will only happen in a > single place. That creates an additional switch on the node's type as > a small trade off. Grouping both assignments in a single setQueryLocationAndLength() is less confusing. > Also, there was an unnecessary cast in analyze.c "result->utilityStmt > =3D (Node *) parseTree;" as parseTree is already a Node. I removed it in > 0001. Indeed. It does not matter one way or another and we have plenty of these in the tree. I have some more minor comments. - if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ - @$ =3D @2; With 14e5680eee19 now in the tree (interesting timing as this did not exist until yesterday), it looks like we don't need these ones anymore, no? @@ -18943,11 +19004,13 @@ insertSelectOptions(SelectStmt *stmt, + /* Update SelectStmt's location to the start of the with clause */ + stmt->stmt_location =3D withClause->location; I have been wondering for a bit what this is about, and indeed this makes the location setup easier to think about with the various SELECT rules we need to deal with (the ones calling insertSelectOptions), and WITH is just in a subset of them. So LGTM. + ParseLoc p_stmt_location; /* start location, or -1 if unknown */ + ParseLoc p_stmt_len; /* length in bytes; 0 means "rest of string= " */ So, the reason why these two fields are added to the ParseState is that the lower layers in charge of the query transforms don't have to RawStmt so as the location and lengths can be adjusted when queries are between parenthesis. I was first wondering if we should push RawStmt deeper into the argument stack, but based on the stmt_location assignments for the DMLs and WITH, storing that in the ParseState looks neater. The patch is lacking a description of these two fields at the top of the ParseState structure in parse_node.h. This stuff needs to be explained, aka we need them to be able to adjust the locations and lengths depending on inner clauses of the queries we are dealing with, or something like that. While reviewing the whole, I've done some changes, mostly stylistic. Please see the attach about them, that I have kept outside of your v11-0001 for clarity. I still need to dive deeper into v11-0002 (not attached here), but let's take one step at a time and conclude on v11-0001 first.. -- Michael --VgCCNXyoan5DuLqB Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="v12-0001-Track-location-to-extract-relevant-part-in-neste.patch" Content-Transfer-Encoding: quoted-printable =46rom 2dc0834a6d8cee9a96a120743619f7defc8f24c9 Mon Sep 17 00:00:00 2001 =46rom: Michael Paquier Date: Wed, 23 Oct 2024 13:07:52 +0900 Subject: [PATCH v12 1/2] Track location to extract relevant part in nested statement Previously, Query generated through transform would have unset stmt_location. Extensions relying on the statement location to extract the relevant part of the statement would fallback to use the whole statement instead, thus showing the same string at the top and nested level, which was a source of confusion. This patch fixes the issue by keeping track of the statement locations and propagate it to Query during transform, allowing pgss to only show the relevant part of the query for nested query. --- src/include/nodes/parsenodes.h | 10 ++ src/include/parser/parse_node.h | 2 + src/backend/parser/analyze.c | 90 +++++++++- src/backend/parser/gram.y | 79 ++++++++- .../expected/level_tracking.out | 165 +++++++++--------- .../pg_stat_statements/expected/planning.out | 10 +- .../pg_stat_statements/expected/select.out | 2 +- .../pg_stat_statements/expected/utility.out | 2 +- contrib/pg_stat_statements/sql/planning.sql | 4 +- 9 files changed, 261 insertions(+), 103 deletions(-) diff --git a/src/include/nodes/parsenodes.h b/src/include/nodes/parsenodes.h index c92cef3d16..b40b661ec8 100644 --- a/src/include/nodes/parsenodes.h +++ b/src/include/nodes/parsenodes.h @@ -2046,6 +2046,8 @@ typedef struct InsertStmt List *returningList; /* list of expressions to return */ WithClause *withClause; /* WITH clause */ OverridingKind override; /* OVERRIDING clause */ + ParseLoc stmt_location; /* start location, or -1 if unknown */ + ParseLoc stmt_len; /* length in bytes; 0 means "rest of string" */ } InsertStmt; =20 /* ---------------------- @@ -2060,6 +2062,8 @@ typedef struct DeleteStmt Node *whereClause; /* qualifications */ List *returningList; /* list of expressions to return */ WithClause *withClause; /* WITH clause */ + ParseLoc stmt_location; /* start location, or -1 if unknown */ + ParseLoc stmt_len; /* length in bytes; 0 means "rest of string" */ } DeleteStmt; =20 /* ---------------------- @@ -2075,6 +2079,8 @@ typedef struct UpdateStmt List *fromClause; /* optional from clause for more tables */ List *returningList; /* list of expressions to return */ WithClause *withClause; /* WITH clause */ + ParseLoc stmt_location; /* start location, or -1 if unknown */ + ParseLoc stmt_len; /* length in bytes; 0 means "rest of string" */ } UpdateStmt; =20 /* ---------------------- @@ -2090,6 +2096,8 @@ typedef struct MergeStmt List *mergeWhenClauses; /* list of MergeWhenClause(es) */ List *returningList; /* list of expressions to return */ WithClause *withClause; /* WITH clause */ + ParseLoc stmt_location; /* start location, or -1 if unknown */ + ParseLoc stmt_len; /* length in bytes; 0 means "rest of string" */ } MergeStmt; =20 /* ---------------------- @@ -2159,6 +2167,8 @@ typedef struct SelectStmt bool all; /* ALL specified? */ struct SelectStmt *larg; /* left child */ struct SelectStmt *rarg; /* right child */ + ParseLoc stmt_location; /* start location, or -1 if unknown */ + ParseLoc stmt_len; /* length in bytes; 0 means "rest of string" */ /* Eventually add fields for CORRESPONDING spec here */ } SelectStmt; =20 diff --git a/src/include/parser/parse_node.h b/src/include/parser/parse_nod= e.h index 543df56814..ba572b3aea 100644 --- a/src/include/parser/parse_node.h +++ b/src/include/parser/parse_node.h @@ -193,6 +193,8 @@ struct ParseState { ParseState *parentParseState; /* stack link */ const char *p_sourcetext; /* source text, or NULL if not available */ + ParseLoc p_stmt_location; /* start location, or -1 if unknown */ + ParseLoc p_stmt_len; /* length in bytes; 0 means "rest of string" */ List *p_rtable; /* range table so far */ List *p_rteperminfos; /* list of RTEPermissionInfo nodes for each * RTE_RELATION entry in rtable */ diff --git a/src/backend/parser/analyze.c b/src/backend/parser/analyze.c index 8a6ba1692e..dc71693619 100644 --- a/src/backend/parser/analyze.c +++ b/src/backend/parser/analyze.c @@ -238,6 +238,74 @@ parse_sub_analyze(Node *parseTree, ParseState *parentP= arseState, return query; } =20 +/* + * setQueryLocationAndLength + * Set query's location and length from statement and ParseState + * + * Some statements, like PreparableStmt, can be located within parentheses. + * For example "(SELECT 1)" or "COPY (UPDATE ...) to x;". For those, we ca= n't + * use the whole string from the statement's location or the SQL string wi= ll + * yield "SELECT 1)". The parser will set stmt_len, reflecting the size of= the + * statement within the parentheses. Thus, when stmt_len is available, we = need + * to use it for the Query's stmt_len. + * + * For other cases, the parser can't provide the length of individual stat= ements. + * However, we have the statement's location plus the length (p_stmt_len) = and + * location (p_stmt_location) of the top level RawStmt, stored in pstate. = Thus, + * the statement's length is the RawStmt's length minus how much we've adv= anced + * in the RawStmt's string. + */ +static void +setQueryLocationAndLength(ParseState *pstate, Query *qry, Node *parseTree) +{ + ParseLoc stmt_len =3D 0; + + switch (nodeTag(parseTree)) + { + case T_InsertStmt: + qry->stmt_location =3D ((InsertStmt *) parseTree)->stmt_location; + stmt_len =3D ((InsertStmt *) parseTree)->stmt_len; + break; + case T_DeleteStmt: + qry->stmt_location =3D ((DeleteStmt *) parseTree)->stmt_location; + stmt_len =3D ((DeleteStmt *) parseTree)->stmt_len; + break; + + case T_UpdateStmt: + qry->stmt_location =3D ((UpdateStmt *) parseTree)->stmt_location; + stmt_len =3D ((UpdateStmt *) parseTree)->stmt_len; + break; + + case T_MergeStmt: + qry->stmt_location =3D ((MergeStmt *) parseTree)->stmt_location; + stmt_len =3D ((MergeStmt *) parseTree)->stmt_len; + break; + + case T_SelectStmt: + qry->stmt_location =3D ((SelectStmt *) parseTree)->stmt_location; + stmt_len =3D ((SelectStmt *) parseTree)->stmt_len; + break; + + case T_PLAssignStmt: + qry->stmt_location =3D ((PLAssignStmt *) parseTree)->location; + break; + + default: + qry->stmt_location =3D pstate->p_stmt_location; + break; + } + if (stmt_len > 0) + /* Statement's length is known, use it */ + qry->stmt_len =3D stmt_len; + else + + /* + * Compute the statement's length from statement's location and + * RawStmt's length and location + */ + qry->stmt_len =3D pstate->p_stmt_len - (qry->stmt_location - pstate->p_s= tmt_location); +} + /* * transformTopLevelStmt - * transform a Parse tree into a Query tree. @@ -250,12 +318,13 @@ transformTopLevelStmt(ParseState *pstate, RawStmt *pa= rseTree) { Query *result; =20 + /* Store RawStmt's length and location in pstate */ + pstate->p_stmt_len =3D parseTree->stmt_len; + pstate->p_stmt_location =3D parseTree->stmt_location; + /* We're at top level, so allow SELECT INTO */ result =3D transformOptionalSelectInto(pstate, parseTree->stmt); =20 - result->stmt_location =3D parseTree->stmt_location; - result->stmt_len =3D parseTree->stmt_len; - return result; } =20 @@ -417,13 +486,14 @@ transformStmt(ParseState *pstate, Node *parseTree) */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; - result->utilityStmt =3D (Node *) parseTree; + result->utilityStmt =3D parseTree; break; } =20 /* Mark as original query until we learn differently */ result->querySource =3D QSRC_ORIGINAL; result->canSetTag =3D true; + setQueryLocationAndLength(pstate, result, parseTree); =20 return result; } @@ -2397,6 +2467,8 @@ transformReturnStmt(ParseState *pstate, ReturnStmt *s= tmt) Query *qry =3D makeNode(Query); =20 qry->commandType =3D CMD_SELECT; + qry->stmt_location =3D pstate->p_stmt_location; + qry->stmt_len =3D pstate->p_stmt_len; qry->isReturn =3D true; =20 qry->targetList =3D list_make1(makeTargetEntry((Expr *) transformExpr(pst= ate, stmt->returnval, EXPR_KIND_SELECT_TARGET), @@ -2677,6 +2749,8 @@ transformPLAssignStmt(ParseState *pstate, PLAssignStm= t *stmt) * consider WITH or INTO, and we build a targetlist our own way. */ qry->commandType =3D CMD_SELECT; + qry->stmt_location =3D pstate->p_stmt_location; + qry->stmt_len =3D pstate->p_stmt_len; pstate->p_is_insert =3D false; =20 /* make FOR UPDATE/FOR SHARE info available to addRangeTableEntry */ @@ -2948,6 +3022,8 @@ transformDeclareCursorStmt(ParseState *pstate, Declar= eCursorStmt *stmt) /* represent the command as a utility Query */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; + result->stmt_location =3D pstate->p_stmt_location; + result->stmt_len =3D pstate->p_stmt_len; result->utilityStmt =3D (Node *) stmt; =20 return result; @@ -3003,6 +3079,8 @@ transformExplainStmt(ParseState *pstate, ExplainStmt = *stmt) /* represent the command as a utility Query */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; + result->stmt_location =3D pstate->p_stmt_location; + result->stmt_len =3D pstate->p_stmt_len; result->utilityStmt =3D (Node *) stmt; =20 return result; @@ -3083,6 +3161,8 @@ transformCreateTableAsStmt(ParseState *pstate, Create= TableAsStmt *stmt) /* represent the command as a utility Query */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; + result->stmt_location =3D pstate->p_stmt_location; + result->stmt_len =3D pstate->p_stmt_len; result->utilityStmt =3D (Node *) stmt; =20 return result; @@ -3207,6 +3287,8 @@ transformCallStmt(ParseState *pstate, CallStmt *stmt) /* represent the command as a utility Query */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; + result->stmt_location =3D pstate->p_stmt_location; + result->stmt_len =3D pstate->p_stmt_len; result->utilityStmt =3D (Node *) stmt; =20 return result; diff --git a/src/backend/parser/gram.y b/src/backend/parser/gram.y index 4bab2117d9..172a26e10e 100644 --- a/src/backend/parser/gram.y +++ b/src/backend/parser/gram.y @@ -153,6 +153,7 @@ static void base_yyerror(YYLTYPE *yylloc, core_yyscan_t= yyscanner, const char *msg); static RawStmt *makeRawStmt(Node *stmt, int stmt_location); static void updateRawStmtEnd(RawStmt *rs, int end_location); +static void updatePreparableStmtEnd(Node *n, int end_location); static Node *makeColumnRef(char *colname, List *indirection, int location, core_yyscan_t yyscanner); static Node *makeTypeCast(Node *arg, TypeName *typename, int location); @@ -176,7 +177,7 @@ static void insertSelectOptions(SelectStmt *stmt, SelectLimit *limitClause, WithClause *withClause, core_yyscan_t yyscanner); -static Node *makeSetOp(SetOperation op, bool all, Node *larg, Node *rarg); +static Node *makeSetOp(SetOperation op, bool all, Node *larg, Node *rarg, = int location); static Node *doNegate(Node *n, int location); static void doNegateFloat(Float *v); static Node *makeAndExpr(Node *lexpr, Node *rexpr, int location); @@ -3383,6 +3384,7 @@ CopyStmt: COPY opt_binary qualified_name opt_column_l= ist { CopyStmt *n =3D makeNode(CopyStmt); =20 + updatePreparableStmtEnd($3, @4); n->relation =3D NULL; n->query =3D $3; n->attlist =3D NIL; @@ -12150,6 +12152,9 @@ InsertStmt: $5->onConflictClause =3D $6; $5->returningList =3D $7; $5->withClause =3D $1; + if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ + @$ =3D @2; + $5->stmt_location =3D @$; $$ =3D (Node *) $5; } ; @@ -12303,6 +12308,9 @@ DeleteStmt: opt_with_clause DELETE_P FROM relation_= expr_opt_alias n->whereClause =3D $6; n->returningList =3D $7; n->withClause =3D $1; + if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ + @$ =3D @2; + n->stmt_location =3D @$; $$ =3D (Node *) n; } ; @@ -12377,6 +12385,9 @@ UpdateStmt: opt_with_clause UPDATE relation_expr_op= t_alias n->whereClause =3D $7; n->returningList =3D $8; n->withClause =3D $1; + if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ + @$ =3D @2; + n->stmt_location =3D @$; $$ =3D (Node *) n; } ; @@ -12454,6 +12465,9 @@ MergeStmt: m->joinCondition =3D $8; m->mergeWhenClauses =3D $9; m->returningList =3D $10; + if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ + @$ =3D @2; + m->stmt_location =3D @$; =20 $$ =3D (Node *) m; } @@ -12694,7 +12708,20 @@ SelectStmt: select_no_parens %prec UMINUS ; =20 select_with_parens: - '(' select_no_parens ')' { $$ =3D $2; } + '(' select_no_parens ')' + { + SelectStmt *n =3D (SelectStmt *) $2; + /* + * As SelectStmt's location starts at the SELECT keyword, + * we need to track the length of the SelectStmt within + * parentheses to be able to extract the relevant part + * of the query. Without this, the RawStmt's length will + * be used and will include the closing parenthesis, + * "SELECT 1)". + */ + n->stmt_len =3D @3 - @2; + $$ =3D $2; + } | '(' select_with_parens ')' { $$ =3D $2; } ; =20 @@ -12816,6 +12843,7 @@ simple_select: n->groupDistinct =3D ($7)->distinct; n->havingClause =3D $8; n->windowClause =3D $9; + n->stmt_location =3D @1; $$ =3D (Node *) n; } | SELECT distinct_clause target_list @@ -12833,6 +12861,7 @@ simple_select: n->groupDistinct =3D ($7)->distinct; n->havingClause =3D $8; n->windowClause =3D $9; + n->stmt_location =3D @1; $$ =3D (Node *) n; } | values_clause { $$ =3D $1; } @@ -12853,19 +12882,20 @@ simple_select: =20 n->targetList =3D list_make1(rt); n->fromClause =3D list_make1($2); + n->stmt_location =3D @1; $$ =3D (Node *) n; } | select_clause UNION set_quantifier select_clause { - $$ =3D makeSetOp(SETOP_UNION, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $4); + $$ =3D makeSetOp(SETOP_UNION, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $4, @= 1); } | select_clause INTERSECT set_quantifier select_clause { - $$ =3D makeSetOp(SETOP_INTERSECT, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $= 4); + $$ =3D makeSetOp(SETOP_INTERSECT, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $= 4, @1); } | select_clause EXCEPT set_quantifier select_clause { - $$ =3D makeSetOp(SETOP_EXCEPT, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $4); + $$ =3D makeSetOp(SETOP_EXCEPT, $3 =3D=3D SET_QUANTIFIER_ALL, $1, $4, = @1); } ; =20 @@ -13423,6 +13453,7 @@ values_clause: { SelectStmt *n =3D makeNode(SelectStmt); =20 + n->stmt_location =3D @1; n->valuesLists =3D list_make1($3); $$ =3D (Node *) n; } @@ -18565,6 +18596,39 @@ updateRawStmtEnd(RawStmt *rs, int end_location) rs->stmt_len =3D end_location - rs->stmt_location; } =20 +/* Adjust a PreparableStmt to reflect that it doesn't run to the end of th= e string */ +static void +updatePreparableStmtEnd(Node *n, int end_location) +{ + if (IsA(n, SelectStmt)) + { + SelectStmt *stmt =3D (SelectStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; + } + else if (IsA(n, InsertStmt)) + { + InsertStmt *stmt =3D (InsertStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; + } + else if (IsA(n, UpdateStmt)) + { + UpdateStmt *stmt =3D (UpdateStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; + } + else if (IsA(n, DeleteStmt)) + { + DeleteStmt *stmt =3D (DeleteStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; + } + else if (IsA(n, MergeStmt)) + { + MergeStmt *stmt =3D (MergeStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; + } + else + elog(ERROR, "unexpected node type %d", (int) n->type); +} + static Node * makeColumnRef(char *colname, List *indirection, int location, core_yyscan_t yyscanner) @@ -18943,11 +19007,13 @@ insertSelectOptions(SelectStmt *stmt, errmsg("multiple WITH clauses not allowed"), parser_errposition(exprLocation((Node *) withClause)))); stmt->withClause =3D withClause; + /* Update SelectStmt's location to the start of the with clause */ + stmt->stmt_location =3D withClause->location; } } =20 static Node * -makeSetOp(SetOperation op, bool all, Node *larg, Node *rarg) +makeSetOp(SetOperation op, bool all, Node *larg, Node *rarg, int location) { SelectStmt *n =3D makeNode(SelectStmt); =20 @@ -18955,6 +19021,7 @@ makeSetOp(SetOperation op, bool all, Node *larg, No= de *rarg) n->all =3D all; n->larg =3D (SelectStmt *) larg; n->rarg =3D (SelectStmt *) rarg; + n->stmt_location =3D location; return (Node *) n; } =20 diff --git a/contrib/pg_stat_statements/expected/level_tracking.out b/contr= ib/pg_stat_statements/expected/level_tracking.out index 8f008f8bfd..489dc7143f 100644 --- a/contrib/pg_stat_statements/expected/level_tracking.out +++ b/contrib/pg_stat_statements/expected/level_tracking.out @@ -206,37 +206,37 @@ EXPLAIN (COSTS OFF) SELECT 1 UNION SELECT 2; =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | query = =20 -----------+-------+-------------------------------------------------------= -------------- + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= ------------- + f | 1 | DELETE FROM stats_track_tab t | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2) - f | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2); t | 1 | EXPLAIN (COSTS OFF) (TABLE test_table) - f | 1 | EXPLAIN (COSTS OFF) (TABLE test_table); t | 1 | EXPLAIN (COSTS OFF) (VALUES ($1, $2)) - f | 1 | EXPLAIN (COSTS OFF) (VALUES ($1, $2)); t | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab - f | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab; t | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= (($1)) - f | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= (($1)); - t | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + - | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + + t | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + + | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) - f | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + - | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + - | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id); t | 1 | EXPLAIN (COSTS OFF) SELECT $1 t | 1 | EXPLAIN (COSTS OFF) SELECT $1 UNION SELECT $2 - f | 1 | EXPLAIN (COSTS OFF) SELECT $1 UNION SELECT $2; - f | 1 | EXPLAIN (COSTS OFF) SELECT $1; t | 1 | EXPLAIN (COSTS OFF) TABLE stats_track_tab - f | 1 | EXPLAIN (COSTS OFF) TABLE stats_track_tab; t | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $= 1 WHERE x =3D $2 - f | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $= 1 WHERE x =3D $2; t | 1 | EXPLAIN (COSTS OFF) VALUES ($1) - f | 1 | EXPLAIN (COSTS OFF) VALUES ($1); + f | 1 | INSERT INTO stats_track_tab VALUES (($1)) + f | 1 | MERGE INTO stats_track_tab = + + | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) + f | 1 | SELECT $1 + f | 1 | SELECT $1 UNION SELECT $2 + f | 1 | SELECT $1, $2 t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t + f | 1 | TABLE stats_track_tab + f | 1 | TABLE test_table + f | 1 | UPDATE stats_track_tab SET x =3D $1 WHERE x =3D $2 + f | 1 | VALUES ($1) + f | 1 | VALUES ($1, $2) (23 rows) =20 -- EXPLAIN - top-level tracking. @@ -405,20 +405,20 @@ EXPLAIN (COSTS OFF) SELECT 1, 2 UNION SELECT 3, 4\; E= XPLAIN (COSTS OFF) (SELECT =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | = query =20 -----------+-------+-------------------------------------------------------= -------------------------------------------------------------- + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= ---------- + f | 1 | (SELECT $1, $2, $3) UNION SELECT $4, $5, $6 t | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2, $3) t | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2, $3) UNION SELECT $= 4, $5, $6 - f | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2, $3); EXPLAIN (COST= S OFF) (SELECT 1, 2, 3, 4); t | 1 | EXPLAIN (COSTS OFF) (SELECT $1, $2, $3, $4) - f | 1 | EXPLAIN (COSTS OFF) (SELECT 1, 2, 3); EXPLAIN (COSTS O= FF) (SELECT $1, $2, $3, $4); t | 1 | EXPLAIN (COSTS OFF) SELECT $1 t | 1 | EXPLAIN (COSTS OFF) SELECT $1, $2 t | 1 | EXPLAIN (COSTS OFF) SELECT $1, $2 UNION SELECT $3, $4 - f | 1 | EXPLAIN (COSTS OFF) SELECT $1, $2 UNION SELECT $3, $4;= EXPLAIN (COSTS OFF) (SELECT 1, 2, 3) UNION SELECT 3, 4, 5; - f | 1 | EXPLAIN (COSTS OFF) SELECT $1; EXPLAIN (COSTS OFF) SEL= ECT 1, 2; - f | 1 | EXPLAIN (COSTS OFF) SELECT 1, 2 UNION SELECT 3, 4; EXP= LAIN (COSTS OFF) (SELECT $1, $2, $3) UNION SELECT $4, $5, $6; - f | 1 | EXPLAIN (COSTS OFF) SELECT 1; EXPLAIN (COSTS OFF) SELE= CT $1, $2; + f | 1 | SELECT $1 + f | 1 | SELECT $1, $2 + f | 1 | SELECT $1, $2 UNION SELECT $3, $4 + f | 1 | SELECT $1, $2, $3 + f | 1 | SELECT $1, $2, $3, $4 t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t (13 rows) =20 @@ -494,29 +494,29 @@ EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUE= S ((1))\; EXPLAIN (COSTS OF =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | = query = =20 -----------+-------+-------------------------------------------------------= --------------------------------------------------------------------------- + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= ------------- + f | 1 | DELETE FROM stats_track_tab + f | 1 | DELETE FROM stats_track_tab WHERE x =3D $1 t | 1 | EXPLAIN (COSTS OFF) (TABLE test_table) t | 1 | EXPLAIN (COSTS OFF) (VALUES ($1, $2)) t | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab t | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab WHERE = x =3D $1 - f | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab; EXPLA= IN (COSTS OFF) DELETE FROM stats_track_tab WHERE x =3D $1; - f | 1 | EXPLAIN (COSTS OFF) DELETE FROM stats_track_tab; EXPLA= IN (COSTS OFF) DELETE FROM stats_track_tab WHERE x =3D 1; t | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= ($1), ($2) t | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= (($1)) - f | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= (($1)); EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES (1), (2); - f | 1 | EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES= ((1)); EXPLAIN (COSTS OFF) INSERT INTO stats_track_tab VALUES ($1), ($2); t | 1 | EXPLAIN (COSTS OFF) TABLE stats_track_tab - f | 1 | EXPLAIN (COSTS OFF) TABLE stats_track_tab; EXPLAIN (CO= STS OFF) (TABLE test_table); - f | 1 | EXPLAIN (COSTS OFF) TABLE stats_track_tab; EXPLAIN (CO= STS OFF) (TABLE test_table); t | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $1 t | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $= 1 WHERE x =3D $2 - f | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $= 1 WHERE x =3D $2; EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D 1; - f | 1 | EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D 1= WHERE x =3D 1; EXPLAIN (COSTS OFF) UPDATE stats_track_tab SET x =3D $1; t | 1 | EXPLAIN (COSTS OFF) VALUES ($1) - f | 1 | EXPLAIN (COSTS OFF) VALUES ($1); EXPLAIN (COSTS OFF) (= VALUES (1, 2)); - f | 1 | EXPLAIN (COSTS OFF) VALUES (1); EXPLAIN (COSTS OFF) (V= ALUES ($1, $2)); + f | 1 | INSERT INTO stats_track_tab VALUES ($1), ($2) + f | 1 | INSERT INTO stats_track_tab VALUES (($1)) t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t + f | 1 | TABLE stats_track_tab + f | 1 | TABLE test_table + f | 1 | UPDATE stats_track_tab SET x =3D $1 + f | 1 | UPDATE stats_track_tab SET x =3D $1 WHERE x =3D $2 + f | 1 | VALUES ($1) + f | 1 | VALUES ($1, $2) (21 rows) =20 SELECT pg_stat_statements_reset() IS NOT NULL AS t; @@ -547,21 +547,18 @@ EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | query = =20 -----------+-------+-------------------------------------------------------= ----------------------------------------- - t | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + - | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= -------- + t | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + + | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id+ + | | WHEN MATCHED THEN UPDATE SET x =3D id = + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) - f | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + - | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + - | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id); EXPLAI= N (COSTS OFF) SELECT 1, 2, 3, 4, 5; - f | 1 | EXPLAIN (COSTS OFF) MERGE INTO stats_track_tab = + - | | USING (SELECT id FROM generate_series(1, 10) id) ON = x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + - | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id); EXPLAI= N (COSTS OFF) SELECT $1, $2, $3, $4, $5; t | 1 | EXPLAIN (COSTS OFF) SELECT $1, $2, $3, $4, $5 + f | 1 | MERGE INTO stats_track_tab = + + | | USING (SELECT id FROM generate_series($1, $2) id) ON= x =3D id+ + | | WHEN MATCHED THEN UPDATE SET x =3D id = + + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) + f | 1 | SELECT $1, $2, $3, $4, $5 t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t (5 rows) =20 @@ -789,29 +786,29 @@ EXPLAIN (COSTS OFF) WITH a AS (select 4) SELECT 1 UNI= ON SELECT 2; =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | query = =20 -----------+-------+-------------------------------------------------------= ------------------------------------ + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= ----------------------------------- t | 1 | EXPLAIN (COSTS OFF) (WITH a AS (SELECT $1) (SELECT $2,= $3)) - f | 1 | EXPLAIN (COSTS OFF) (WITH a AS (SELECT $1) (SELECT $2,= $3)); t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) DELETE FROM = stats_track_tab - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) DELETE FROM = stats_track_tab; t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) INSERT INTO = stats_track_tab VALUES (($2)) - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) INSERT INTO = stats_track_tab VALUES (($2)); - t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) MERGE INTO s= tats_track_tab + - | | USING (SELECT id FROM generate_series($2, $3) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + + t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) MERGE INTO s= tats_track_tab + + | | USING (SELECT id FROM generate_series($2, $3) id) ON= x =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) MERGE INTO s= tats_track_tab + - | | USING (SELECT id FROM generate_series($2, $3) id) ON= x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + - | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id); t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) SELECT $2 - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) SELECT $2; t | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) UPDATE stats= _track_tab SET x =3D $2 WHERE x =3D $3 - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (SELECT $1) UPDATE stats= _track_tab SET x =3D $2 WHERE x =3D $3; t | 1 | EXPLAIN (COSTS OFF) WITH a AS (select $1) SELECT $2 UN= ION SELECT $3 - f | 1 | EXPLAIN (COSTS OFF) WITH a AS (select $1) SELECT $2 UN= ION SELECT $3; t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t + f | 1 | WITH a AS (SELECT $1) (SELECT $2, $3) + f | 1 | WITH a AS (SELECT $1) DELETE FROM stats_track_tab + f | 1 | WITH a AS (SELECT $1) INSERT INTO stats_track_tab VALU= ES (($2)) + f | 1 | WITH a AS (SELECT $1) MERGE INTO stats_track_tab = + + | | USING (SELECT id FROM generate_series($2, $3) id) ON= x =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) + f | 1 | WITH a AS (SELECT $1) SELECT $2 + f | 1 | WITH a AS (SELECT $1) UPDATE stats_track_tab SET x =3D= $2 WHERE x =3D $3 + f | 1 | WITH a AS (select $1) SELECT $2 UNION SELECT $3 (15 rows) =20 -- EXPLAIN with CTEs - top-level tracking @@ -921,12 +918,12 @@ EXPLAIN (ANALYZE, COSTS OFF, SUMMARY OFF, TIMING OFF) =20 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | query = =20 -----------+-------+-------------------------------------------------------= ----------- - t | 1 | EXPLAIN (ANALYZE, COSTS OFF, SUMMARY OFF, TIMING OFF) = + + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= ---------- + t | 1 | EXPLAIN (ANALYZE, COSTS OFF, SUMMARY OFF, TIMING OFF) = + | | DECLARE foocur CURSOR FOR SELECT * FROM stats_track_= tab t | 1 | EXPLAIN (ANALYZE, COSTS OFF, SUMMARY OFF, TIMING OFF) = SELECT $1 - f | 1 | EXPLAIN (ANALYZE, COSTS OFF, SUMMARY OFF, TIMING OFF) = SELECT $1; + f | 1 | SELECT $1 t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t (4 rows) =20 @@ -1050,8 +1047,8 @@ SELECT toplevel, calls, query FROM pg_stat_statements ----------+-------+-------------------------------------------------------= ---------- t | 1 | CREATE TEMPORARY TABLE pgss_ctas_1 AS SELECT $1 t | 1 | CREATE TEMPORARY TABLE pgss_ctas_2 AS EXECUTE test_pre= pare_pgss - f | 1 | PREPARE test_prepare_pgss AS select generate_series($1= , $2) t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t + f | 1 | select generate_series($1, $2) (4 rows) =20 -- CREATE TABLE AS, top-level tracking. @@ -1202,25 +1199,25 @@ COPY (DELETE FROM stats_track_tab WHERE x =3D 2 RET= URNING x) TO stdout; 2 SELECT toplevel, calls, query FROM pg_stat_statements ORDER BY query COLLATE "C"; - toplevel | calls | query = =20 -----------+-------+-------------------------------------------------------= ---------------------- - f | 1 | COPY (DELETE FROM stats_track_tab WHERE x =3D $1 RETUR= NING x) TO stdout + toplevel | calls | query = =20 +----------+-------+-------------------------------------------------------= -------------------- t | 1 | COPY (DELETE FROM stats_track_tab WHERE x =3D 2 RETURN= ING x) TO stdout - f | 1 | COPY (INSERT INTO stats_track_tab (x) VALUES ($1) RETU= RNING x) TO stdout t | 1 | COPY (INSERT INTO stats_track_tab (x) VALUES (1) RETUR= NING x) TO stdout - f | 1 | COPY (MERGE INTO stats_track_tab USING (SELECT $1 id) = ON x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + + t | 1 | COPY (MERGE INTO stats_track_tab USING (SELECT 1 id) O= N x =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) RETURNI= NG x) TO stdout - t | 1 | COPY (MERGE INTO stats_track_tab USING (SELECT 1 id) O= N x =3D id + - | | WHEN MATCHED THEN UPDATE SET x =3D id = + - | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) RETURNI= NG x) TO stdout - f | 1 | COPY (SELECT $1 UNION SELECT $2) TO stdout - f | 1 | COPY (SELECT $1) TO stdout t | 1 | COPY (SELECT 1 UNION SELECT 2) TO stdout t | 1 | COPY (SELECT 1) TO stdout - f | 1 | COPY (UPDATE stats_track_tab SET x =3D $1 WHERE x =3D = $2 RETURNING x) TO stdout t | 1 | COPY (UPDATE stats_track_tab SET x =3D 2 WHERE x =3D 1= RETURNING x) TO stdout + f | 1 | DELETE FROM stats_track_tab WHERE x =3D $1 RETURNING x + f | 1 | INSERT INTO stats_track_tab (x) VALUES ($1) RETURNING x + f | 1 | MERGE INTO stats_track_tab USING (SELECT $1 id) ON x = =3D id + + | | WHEN MATCHED THEN UPDATE SET x =3D id = + + | | WHEN NOT MATCHED THEN INSERT (x) VALUES (id) RETURNI= NG x + f | 1 | SELECT $1 + f | 1 | SELECT $1 UNION SELECT $2 t | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t + f | 1 | UPDATE stats_track_tab SET x =3D $1 WHERE x =3D $2 RET= URNING x (13 rows) =20 -- COPY - top-level tracking. diff --git a/contrib/pg_stat_statements/expected/planning.out b/contrib/pg_= stat_statements/expected/planning.out index 9effd11fdc..3ee1928cbe 100644 --- a/contrib/pg_stat_statements/expected/planning.out +++ b/contrib/pg_stat_statements/expected/planning.out @@ -58,7 +58,7 @@ SELECT 42; (1 row) =20 SELECT plans, calls, rows, query FROM pg_stat_statements - WHERE query NOT LIKE 'PREPARE%' ORDER BY query COLLATE "C"; + WHERE query NOT LIKE 'SELECT COUNT%' ORDER BY query COLLATE "C"; plans | calls | rows | query = =20 -------+-------+------+---------------------------------------------------= ------- 0 | 1 | 0 | ALTER TABLE stats_plan_test ADD COLUMN x int @@ -72,10 +72,10 @@ SELECT plans, calls, rows, query FROM pg_stat_statements -- for the prepared statement we expect at least one replan, but cache -- invalidations could force more SELECT plans >=3D 2 AND plans <=3D calls AS plans_ok, calls, rows, query F= ROM pg_stat_statements - WHERE query LIKE 'PREPARE%' ORDER BY query COLLATE "C"; - plans_ok | calls | rows | query = =20 -----------+-------+------+------------------------------------------------= ------- - t | 4 | 4 | PREPARE prep1 AS SELECT COUNT(*) FROM stats_pla= n_test + WHERE query LIKE 'SELECT COUNT%' ORDER BY query COLLATE "C"; + plans_ok | calls | rows | query =20 +----------+-------+------+-------------------------------------- + t | 4 | 4 | SELECT COUNT(*) FROM stats_plan_test (1 row) =20 -- Cleanup diff --git a/contrib/pg_stat_statements/expected/select.out b/contrib/pg_st= at_statements/expected/select.out index e0e2fa265c..37a30af034 100644 --- a/contrib/pg_stat_statements/expected/select.out +++ b/contrib/pg_stat_statements/expected/select.out @@ -128,7 +128,6 @@ DEALLOCATE pgss_test; SELECT calls, rows, query FROM pg_stat_statements ORDER BY query COLLATE "= C"; calls | rows | query = =20 -------+------+-----------------------------------------------------------= ------------------- - 1 | 1 | PREPARE pgss_test (int) AS SELECT $1, $2 LIMIT $3 4 | 4 | SELECT $1 = + | | -- but this one will appear = + | | AS "text" @@ -138,6 +137,7 @@ SELECT calls, rows, query FROM pg_stat_statements ORDER= BY query COLLATE "C"; 2 | 2 | SELECT $1 AS "int" 1 | 2 | SELECT $1 AS i UNION SELECT $2 ORDER BY i 1 | 1 | SELECT $1 || $2 + 1 | 1 | SELECT $1, $2 LIMIT $3 0 | 0 | SELECT calls, rows, query FROM pg_stat_statements ORDER BY= query COLLATE "C" 1 | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t 1 | 2 | WITH t(f) AS ( = + diff --git a/contrib/pg_stat_statements/expected/utility.out b/contrib/pg_s= tat_statements/expected/utility.out index 060d4416dd..aa4f0f7e62 100644 --- a/contrib/pg_stat_statements/expected/utility.out +++ b/contrib/pg_stat_statements/expected/utility.out @@ -540,7 +540,7 @@ SELECT calls, rows, query FROM pg_stat_statements ORDER= BY query COLLATE "C"; -------+------+---------------------------------------------------- 2 | 0 | DEALLOCATE $1 2 | 0 | DEALLOCATE ALL - 2 | 2 | PREPARE stat_select AS SELECT $1 AS a + 2 | 2 | SELECT $1 AS a 1 | 1 | SELECT $1 as a 1 | 1 | SELECT pg_stat_statements_reset() IS NOT NULL AS t (5 rows) diff --git a/contrib/pg_stat_statements/sql/planning.sql b/contrib/pg_stat_= statements/sql/planning.sql index 46f5d9b951..9cfe206b3b 100644 --- a/contrib/pg_stat_statements/sql/planning.sql +++ b/contrib/pg_stat_statements/sql/planning.sql @@ -20,11 +20,11 @@ SELECT 42; SELECT 42; SELECT 42; SELECT plans, calls, rows, query FROM pg_stat_statements - WHERE query NOT LIKE 'PREPARE%' ORDER BY query COLLATE "C"; + WHERE query NOT LIKE 'SELECT COUNT%' ORDER BY query COLLATE "C"; -- for the prepared statement we expect at least one replan, but cache -- invalidations could force more SELECT plans >=3D 2 AND plans <=3D calls AS plans_ok, calls, rows, query F= ROM pg_stat_statements - WHERE query LIKE 'PREPARE%' ORDER BY query COLLATE "C"; + WHERE query LIKE 'SELECT COUNT%' ORDER BY query COLLATE "C"; =20 -- Cleanup DROP TABLE stats_plan_test; --=20 2.45.2 --VgCCNXyoan5DuLqB Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="v12-0002-Some-edits-from-me.patch" Content-Transfer-Encoding: quoted-printable =46rom 181f55dfe0525b98234c02a4f76df1a8c2e3a61b Mon Sep 17 00:00:00 2001 =46rom: Michael Paquier Date: Wed, 23 Oct 2024 15:00:07 +0900 Subject: [PATCH v12 2/2] Some edits from me.. --- src/backend/parser/analyze.c | 33 +++++++++++++++++++-------------- src/backend/parser/gram.y | 19 ++++++++----------- 2 files changed, 27 insertions(+), 25 deletions(-) diff --git a/src/backend/parser/analyze.c b/src/backend/parser/analyze.c index dc71693619..7709fb5e36 100644 --- a/src/backend/parser/analyze.c +++ b/src/backend/parser/analyze.c @@ -243,17 +243,17 @@ parse_sub_analyze(Node *parseTree, ParseState *parent= ParseState, * Set query's location and length from statement and ParseState * * Some statements, like PreparableStmt, can be located within parentheses. - * For example "(SELECT 1)" or "COPY (UPDATE ...) to x;". For those, we ca= n't - * use the whole string from the statement's location or the SQL string wi= ll - * yield "SELECT 1)". The parser will set stmt_len, reflecting the size of= the - * statement within the parentheses. Thus, when stmt_len is available, we = need - * to use it for the Query's stmt_len. + * For example "(SELECT 1)" or "COPY (UPDATE ...) to x;". For those, we + * cannot use the whole string from the statement's location or the SQL + * string would yield incorrectly. The parser will set stmt_len, reflecti= ng + * the size of the statement within the parentheses. Thus, when stmt_len = is + * available, we need to use it for the Query's stmt_len. * - * For other cases, the parser can't provide the length of individual stat= ements. - * However, we have the statement's location plus the length (p_stmt_len) = and - * location (p_stmt_location) of the top level RawStmt, stored in pstate. = Thus, - * the statement's length is the RawStmt's length minus how much we've adv= anced - * in the RawStmt's string. + * For other cases, the parser can't provide the length of individual + * statements. However, we have the statement's location plus its length + * (p_stmt_len) and location (p_stmt_location) of the top level RawStmt, + * stored in pstate. Thus, the statement's length is the RawStmt's length + * minus how much we've advanced in the RawStmt's string. */ static void setQueryLocationAndLength(ParseState *pstate, Query *qry, Node *parseTree) @@ -266,6 +266,7 @@ setQueryLocationAndLength(ParseState *pstate, Query *qr= y, Node *parseTree) qry->stmt_location =3D ((InsertStmt *) parseTree)->stmt_location; stmt_len =3D ((InsertStmt *) parseTree)->stmt_len; break; + case T_DeleteStmt: qry->stmt_location =3D ((DeleteStmt *) parseTree)->stmt_location; stmt_len =3D ((DeleteStmt *) parseTree)->stmt_len; @@ -294,16 +295,20 @@ setQueryLocationAndLength(ParseState *pstate, Query *= qry, Node *parseTree) qry->stmt_location =3D pstate->p_stmt_location; break; } + if (stmt_len > 0) + { /* Statement's length is known, use it */ qry->stmt_len =3D stmt_len; + } else - + { /* - * Compute the statement's length from statement's location and - * RawStmt's length and location + * Compute the statement's length from the statement's location and + * the RawStmt's length and location. */ qry->stmt_len =3D pstate->p_stmt_len - (qry->stmt_location - pstate->p_s= tmt_location); + } } =20 /* @@ -486,7 +491,7 @@ transformStmt(ParseState *pstate, Node *parseTree) */ result =3D makeNode(Query); result->commandType =3D CMD_UTILITY; - result->utilityStmt =3D parseTree; + result->utilityStmt =3D (Node *) parseTree; break; } =20 diff --git a/src/backend/parser/gram.y b/src/backend/parser/gram.y index 172a26e10e..45d02e942a 100644 --- a/src/backend/parser/gram.y +++ b/src/backend/parser/gram.y @@ -12152,8 +12152,6 @@ InsertStmt: $5->onConflictClause =3D $6; $5->returningList =3D $7; $5->withClause =3D $1; - if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ - @$ =3D @2; $5->stmt_location =3D @$; $$ =3D (Node *) $5; } @@ -12308,8 +12306,6 @@ DeleteStmt: opt_with_clause DELETE_P FROM relation_= expr_opt_alias n->whereClause =3D $6; n->returningList =3D $7; n->withClause =3D $1; - if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ - @$ =3D @2; n->stmt_location =3D @$; $$ =3D (Node *) n; } @@ -12385,8 +12381,6 @@ UpdateStmt: opt_with_clause UPDATE relation_expr_op= t_alias n->whereClause =3D $7; n->returningList =3D $8; n->withClause =3D $1; - if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ - @$ =3D @2; n->stmt_location =3D @$; $$ =3D (Node *) n; } @@ -12465,8 +12459,6 @@ MergeStmt: m->joinCondition =3D $8; m->mergeWhenClauses =3D $9; m->returningList =3D $10; - if (@$ < 0) /* see comments for YYLLOC_DEFAULT */ - @$ =3D @2; m->stmt_location =3D @$; =20 $$ =3D (Node *) m; @@ -12711,13 +12703,13 @@ select_with_parens: '(' select_no_parens ')' { SelectStmt *n =3D (SelectStmt *) $2; + /* * As SelectStmt's location starts at the SELECT keyword, * we need to track the length of the SelectStmt within * parentheses to be able to extract the relevant part - * of the query. Without this, the RawStmt's length will - * be used and will include the closing parenthesis, - * "SELECT 1)". + * of the query. Without this, the RawStmt's length would + * be used and would include the closing parenthesis. */ n->stmt_len =3D @3 - @2; $$ =3D $2; @@ -18603,26 +18595,31 @@ updatePreparableStmtEnd(Node *n, int end_location) if (IsA(n, SelectStmt)) { SelectStmt *stmt =3D (SelectStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; } else if (IsA(n, InsertStmt)) { InsertStmt *stmt =3D (InsertStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; } else if (IsA(n, UpdateStmt)) { UpdateStmt *stmt =3D (UpdateStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; } else if (IsA(n, DeleteStmt)) { DeleteStmt *stmt =3D (DeleteStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; } else if (IsA(n, MergeStmt)) { MergeStmt *stmt =3D (MergeStmt *)n; + stmt->stmt_len =3D end_location - stmt->stmt_location; } else --=20 2.45.2 --VgCCNXyoan5DuLqB-- --0g6SVKqrytYIJkee Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEG72nH6vTowiyblFKnvQgOdbyQH0FAmcYk0sACgkQnvQgOdby QH0IJA/6Ao8fX+Nt/LELE1eeG2nHk2kKmWoWTqyr5ifiZq+jfO7g1IwUn0bm+Shs 4lXQZEa29Pf0zb9SfIzmGITpPHoYYqZgH5LZ6g2udNidYrC3pO1Ceg5nuCxCs0Ur +kAwbsiGKNMeihl2wqdGUBEdZ8naMiDi+oQsyqCAkHDx63lKLgdfO5xJdailtJTd ZBVxAvhGHcOI1JkVzEKSEUlzQS+4SV0t7PGasqso73OT0Mjwmi2lgoklL7wyzjQS z/y0ngC9t79PlxWjsT0vMlvIweYDtbPzz5bz3iac2GKw8beUN7tSxn6FrMm88tub wFvpGDyF+gp/QdJfvJ0x+w6fgrcdJ5nrFw1qNslCppX1FwW2CdhkOC1LRRrEc3J0 s7dk64NSlGo0BozbNCFd6wLY+EdqtCvIDJyrxmlSHtqMEmALVEpHalyvQmk7gItT H7Tb1IQAuG0y8pg4yByrU1lD56oGrjVffICKBhtao/RRvdfGX3jv+bRfFrnUPLke mU0NtpjnT6yjwts/0jaVGcah4ctU7pjB0Pacpy3360DzPiH7XdgnmD8/P76y4vwX j0YsYezciBI+ZAfTwDehnWQzsPniaVP4Ua2yCsR2UCOgZOc0moqbRDVynHmZRjtO IM1v4DleuUcmVTfHdsuqtN/GIMZIwZYiUstqcVLooKtU7HIMvnU= =CF/S -----END PGP SIGNATURE----- --0g6SVKqrytYIJkee--