pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Masahiko Sawada <msawada@postgresql.org>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Add progress reporting of skipped tuples during COPY FROM.
Date: Thu, 25 Jan 2024 02:00:45 +0000
Message-ID: <E1rSp2r-002yR2-VR@gemulon.postgresql.org> (raw)

Add progress reporting of skipped tuples during COPY FROM.

9e2d870119 enabled the COPY command to skip malformed data, however
there was no visibility into how many tuples were actually skipped
during the COPY FROM.

This commit adds a new "tuples_skipped" column to
pg_stat_progress_copy view to report the number of tuples that were
skipped because they contain malformed data.

Bump catalog version.

Author: Atsushi Torikoshi
Reviewed-by: Masahiko Sawada
Discussion: https://postgr.es/m/d12fd8c99adcae2744212cb23feff6ed%40oss.nttdata.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/729439607ad210dbb446e31754e8627d7e3f7dda

Modified Files
--------------
doc/src/sgml/monitoring.sgml         | 12 ++++++++++++
src/backend/catalog/system_views.sql |  3 ++-
src/backend/commands/copyfrom.c      |  5 +++++
src/include/catalog/catversion.h     |  2 +-
src/include/commands/progress.h      |  1 +
src/test/regress/expected/rules.out  |  3 ++-
6 files changed, 23 insertions(+), 3 deletions(-)



Message-ID: <E1rSp2r-002yR2-VR@gemulon.postgresql.org>
Permalink:  ../E1rSp2r-002yR2-VR@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1rSp2r-002yR2-VR@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: msawada@postgresql.org, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Add progress reporting of skipped tuples during COPY FROM.
  In-Reply-To: <E1rSp2r-002yR2-VR@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox