Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1gFQo1-0000b8-MV for pgsql-hackers@arkaria.postgresql.org; Wed, 24 Oct 2018 21:35:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1gFQnx-0002SB-T0 for pgsql-hackers@arkaria.postgresql.org; Wed, 24 Oct 2018 21:35:05 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1gFQnx-0002S3-K7 for pgsql-hackers@lists.postgresql.org; Wed, 24 Oct 2018 21:35:05 +0000 Received: from mail-qt1-x82f.google.com ([2607:f8b0:4864:20::82f]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gFQnp-0000zb-1R for pgsql-hackers@postgresql.org; Wed, 24 Oct 2018 21:35:04 +0000 Received: by mail-qt1-x82f.google.com with SMTP id l9-v6so7418061qtj.12 for ; Wed, 24 Oct 2018 14:34:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:subject:message-id:mime-version:content-disposition :content-transfer-encoding:user-agent; bh=h5KbVs69Dt2NND8gVNJraFqq5QWA6tq9UZGH7LEsbYM=; b=P+hrmGyXQ/WQgxAyzXezwUYdLLRhRb3cRQG1IEgi+DeccJVOqQrZAoHqeNG2SkunY5 ++lc6roykwKrohCi1Dy/i85/9245sq+A1niExQCctrMaih40Q4/IMCOUsdKBdKaX1CNF bMOO+1MdqAZ3EuLqrMKFCgWcX2QyXMRRz73WOk973Lx8p7T4KqUlmZRfCUzlGj4vAs8h grzaq3f6wRY2DHlgneGiavZ1MOV6k4dpJzZz6mMesmUS1osenJ5RGQngeMNAaQPb1nKO ORvcxi9T93Ow+f1pWxhNpRWuSmBVOvQuLzmR3kfMbMPciYPczoLBCEWXxgeXF48ozn8g kjOw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-disposition:content-transfer-encoding:user-agent; bh=h5KbVs69Dt2NND8gVNJraFqq5QWA6tq9UZGH7LEsbYM=; b=lo5MTvaIGo+QwB9An+zloUWgkHuGlcmWV52yW1x/zvh2xooHm0rofWO5ygx5oiBrL5 oWQnVjI19hK4uAfPa7M3bkYWQBnSNLh2NEy0dYaR4orSEBWm16Y9L3v/audHanB5vSfw gTt2Ugjp5sHjUiR7KblX53TtIMnwD/JtCwLJ9LAiObEJxTZQnwWQaKScqOP6Gz2by+/c lyFm15ZfIjDst9UG1A86UvjR8/drhiSIXRaVGX2+wMxBSmFDpmu86Zs61GW4ty/oiHD6 wqerZNc948bJkBfbmER4AbRQCoM8kUm9nWsoiXUrYrbf8pEJfVwTaMevwjyNjHJPKXaa 1/2Q== X-Gm-Message-State: AGRZ1gLPWiYV1VaWEZjnknqDPaLeszo2NQcKvTJy7mBdezqFgGvqAB6g kACoUAF6E9+13bY5F40HOzDQjjyF+L1XUmK/hHhzh1ca4qdN6hBI1k8XUovCOmus3fsxClD3D4S efwbu92t7RlLxMea8ArIG6cBw9s+Rs4YKkr4VmsXl/r5SCevPTLCegKujUi5APuWnKFAvlqG1oJ 53Wvk1VA== X-Google-Smtp-Source: AJdET5erct508rSn7rPlxr0X2PMgEhYwrjOc9nq+R+zr+myXwKamrnCsQKLIvvbMR0QyXFeeQTMoWQ== X-Received: by 2002:a0c:bed2:: with SMTP id f18mr4165821qvj.210.1540416894837; Wed, 24 Oct 2018 14:34:54 -0700 (PDT) Received: from alvin.alvh.no-ip.org ([190.121.29.3]) by smtp.gmail.com with ESMTPSA id 128-v6sm3751991qko.7.2018.10.24.14.34.53 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 24 Oct 2018 14:34:54 -0700 (PDT) Received: by alvin.alvh.no-ip.org (Postfix, from userid 1000) id C188D6CD; Wed, 24 Oct 2018 18:34:51 -0300 (-03) Date: Wed, 24 Oct 2018 18:34:51 -0300 From: Alvaro Herrera To: Pg Hackers Subject: notice processors for isolationtester Message-ID: <20181024213451.75nh3f3dctmcdbfq@alvherre.pgsql> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="mstlmmlpv7pjqkw7" Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: NeoMutt/20180716 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk --mstlmmlpv7pjqkw7 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit Recently while testing a patch I found it immensely useful to distinguish which session each WARNING message came from, when bespoke tests were run under isolationtester. Current code does not show that, so I developed this patch adding notice processors, and then it does. -- Álvaro Herrera https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services --mstlmmlpv7pjqkw7 Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="isolationtester-notices.patch" Content-Transfer-Encoding: quoted-printable commit dbbd8840ab070ced5dcd1eefaa67319bd9747b0c=1B[m Author: Alvaro Herrera AuthorDate: Thu Sep 27 16:37:43 2018 -0300 CommitDate: Wed Oct 24 18:31:00 2018 -0300 Have isolationtester prefix WARNING with session name diff --git a/src/test/isolation/expected/vacuum-concurrent-drop.out b/src/t= est/isolation/expected/vacuum-concurrent-drop.out index bb92e80b92..cf348d7e5d 100644 --- a/src/test/isolation/expected/vacuum-concurrent-drop.out +++ b/src/test/isolation/expected/vacuum-concurrent-drop.out @@ -10,7 +10,7 @@ step drop_and_commit: DROP TABLE part2; COMMIT; =20 -WARNING: skipping vacuum of "part2" --- relation no longer exists +s2: WARNING: skipping vacuum of "part2" --- relation no longer exists step vac_specified: <... completed> =20 starting permutation: lock vac_all_parts drop_and_commit @@ -35,7 +35,7 @@ step drop_and_commit: DROP TABLE part2; COMMIT; =20 -WARNING: skipping analyze of "part2" --- relation no longer exists +s2: WARNING: skipping analyze of "part2" --- relation no longer exists step analyze_specified: <... completed> =20 starting permutation: lock analyze_all_parts drop_and_commit @@ -60,7 +60,7 @@ step drop_and_commit: DROP TABLE part2; COMMIT; =20 -WARNING: skipping vacuum of "part2" --- relation no longer exists +s2: WARNING: skipping vacuum of "part2" --- relation no longer exists step vac_analyze_specified: <... completed> =20 starting permutation: lock vac_analyze_all_parts drop_and_commit diff --git a/src/test/isolation/expected/vacuum-conflict.out b/src/test/iso= lation/expected/vacuum-conflict.out index 06ac75ef23..ffde537305 100644 --- a/src/test/isolation/expected/vacuum-conflict.out +++ b/src/test/isolation/expected/vacuum-conflict.out @@ -4,7 +4,7 @@ starting permutation: s1_begin s1_lock s2_auth s2_vacuum s1= _commit s2_reset step s1_begin: BEGIN; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can vacuu= m it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can v= acuum it step s2_vacuum: VACUUM vacuum_tab; step s1_commit: COMMIT; step s2_reset: RESET ROLE; @@ -12,7 +12,7 @@ step s2_reset: RESET ROLE; starting permutation: s1_begin s2_auth s2_vacuum s1_lock s1_commit s2_reset step s1_begin: BEGIN; step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can vacuu= m it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can v= acuum it step s2_vacuum: VACUUM vacuum_tab; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; step s1_commit: COMMIT; @@ -22,14 +22,14 @@ starting permutation: s1_begin s2_auth s1_lock s2_vacuu= m s1_commit s2_reset step s1_begin: BEGIN; step s2_auth: SET ROLE regress_vacuum_conflict; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; -WARNING: skipping "vacuum_tab" --- only table or database owner can vacuu= m it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can v= acuum it step s2_vacuum: VACUUM vacuum_tab; step s1_commit: COMMIT; step s2_reset: RESET ROLE; =20 starting permutation: s2_auth s2_vacuum s1_begin s1_lock s1_commit s2_reset step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can vacuu= m it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can v= acuum it step s2_vacuum: VACUUM vacuum_tab; step s1_begin: BEGIN; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; @@ -40,7 +40,7 @@ starting permutation: s1_begin s1_lock s2_auth s2_analyze= s1_commit s2_reset step s1_begin: BEGIN; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can analy= ze it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can a= nalyze it step s2_analyze: ANALYZE vacuum_tab; step s1_commit: COMMIT; step s2_reset: RESET ROLE; @@ -48,7 +48,7 @@ step s2_reset: RESET ROLE; starting permutation: s1_begin s2_auth s2_analyze s1_lock s1_commit s2_res= et step s1_begin: BEGIN; step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can analy= ze it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can a= nalyze it step s2_analyze: ANALYZE vacuum_tab; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; step s1_commit: COMMIT; @@ -58,14 +58,14 @@ starting permutation: s1_begin s2_auth s1_lock s2_analy= ze s1_commit s2_reset step s1_begin: BEGIN; step s2_auth: SET ROLE regress_vacuum_conflict; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; -WARNING: skipping "vacuum_tab" --- only table or database owner can analy= ze it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can a= nalyze it step s2_analyze: ANALYZE vacuum_tab; step s1_commit: COMMIT; step s2_reset: RESET ROLE; =20 starting permutation: s2_auth s2_analyze s1_begin s1_lock s1_commit s2_res= et step s2_auth: SET ROLE regress_vacuum_conflict; -WARNING: skipping "vacuum_tab" --- only table or database owner can analy= ze it +s2: WARNING: skipping "vacuum_tab" --- only table or database owner can a= nalyze it step s2_analyze: ANALYZE vacuum_tab; step s1_begin: BEGIN; step s1_lock: LOCK vacuum_tab IN SHARE UPDATE EXCLUSIVE MODE; diff --git a/src/test/isolation/expected/vacuum-skip-locked.out b/src/test/= isolation/expected/vacuum-skip-locked.out index 95ca4569cc..99db281a15 100644 --- a/src/test/isolation/expected/vacuum-skip-locked.out +++ b/src/test/isolation/expected/vacuum-skip-locked.out @@ -5,7 +5,7 @@ step lock_share: BEGIN; LOCK part1 IN SHARE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_specified: VACUUM (SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -26,7 +26,7 @@ step lock_share: BEGIN; LOCK part1 IN SHARE MODE; =20 -WARNING: skipping analyze of "part1" --- lock not available +s2: WARNING: skipping analyze of "part1" --- lock not available step analyze_specified: ANALYZE (SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -47,7 +47,7 @@ step lock_share: BEGIN; LOCK part1 IN SHARE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_analyze_specified: VACUUM (ANALYZE, SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -68,7 +68,7 @@ step lock_share: BEGIN; LOCK part1 IN SHARE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_full_specified: VACUUM (SKIP_LOCKED, FULL) part1, part2; step commit:=20 COMMIT; @@ -89,7 +89,7 @@ step lock_access_exclusive: BEGIN; LOCK part1 IN ACCESS EXCLUSIVE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_specified: VACUUM (SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -110,7 +110,7 @@ step lock_access_exclusive: BEGIN; LOCK part1 IN ACCESS EXCLUSIVE MODE; =20 -WARNING: skipping analyze of "part1" --- lock not available +s2: WARNING: skipping analyze of "part1" --- lock not available step analyze_specified: ANALYZE (SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -132,7 +132,7 @@ step lock_access_exclusive: BEGIN; LOCK part1 IN ACCESS EXCLUSIVE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_analyze_specified: VACUUM (ANALYZE, SKIP_LOCKED) part1, part2; step commit:=20 COMMIT; @@ -154,7 +154,7 @@ step lock_access_exclusive: BEGIN; LOCK part1 IN ACCESS EXCLUSIVE MODE; =20 -WARNING: skipping vacuum of "part1" --- lock not available +s2: WARNING: skipping vacuum of "part1" --- lock not available step vac_full_specified: VACUUM (SKIP_LOCKED, FULL) part1, part2; step commit:=20 COMMIT; diff --git a/src/test/isolation/isolationtester.c b/src/test/isolation/isol= ationtester.c index 62097ab961..e2638553f6 100644 --- a/src/test/isolation/isolationtester.c +++ b/src/test/isolation/isolationtester.c @@ -48,6 +48,8 @@ static int step_qsort_cmp(const void *a, const void *b); static int step_bsearch_cmp(const void *a, const void *b); =20 static void printResultSet(PGresult *res); +static void isotesterNoticeProcessor(void *arg, const char *message); +static void blackholeNoticeProcessor(void *arg, const char *message); =20 /* close all connections and exit */ static void @@ -172,6 +174,21 @@ main(int argc, char **argv) } =20 /* + * Set up notice processors for the user-defined connections, so that + * messages can get printed prefixed with the session names. The + * control connection gets a "blackhole" processor instead (hides all + * messages). + */ + if (i !=3D 0) + PQsetNoticeProcessor(conns[i], + isotesterNoticeProcessor, + (void *) (testspec->sessions[i - 1]->name)); + else + PQsetNoticeProcessor(conns[i], + blackholeNoticeProcessor, + NULL); + + /* * Suppress NOTIFY messages, which otherwise pop into results at odd * places. */ @@ -881,3 +898,17 @@ printResultSet(PGresult *res) printf("\n"); } } + +/* notice processor, prefixes each message with the session name */ +static void +isotesterNoticeProcessor(void *arg, const char *message) +{ + fprintf(stderr, "%s: %s", (char *) arg, message); +} + +/* notice processor, hides the message */ +static void +blackholeNoticeProcessor(void *arg, const char *message) +{ + /* do nothing */ +} --mstlmmlpv7pjqkw7--