pg.ddx.io  pgsql-committers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Daniel Gustafsson <dgustafsson@postgresql.org>
To: pgsql-committers@lists.postgresql.org
Subject: pgsql: Read include/exclude commands for dump/restore from file
Date: Wed, 29 Nov 2023 14:21:28 +0000
Message-ID: <E1r8LRQ-007oSu-3G@gemulon.postgresql.org> (raw)

Read include/exclude commands for dump/restore from file

When there is a need to filter multiple tables with include and/or exclude
options it's quite possible to run into the limitations of the commandline.
This adds a --filter=FILENAME feature to pg_dump, pg_dumpall and pg_restore
which is used to supply a file containing object exclude/include commands
which work just like their commandline counterparts. The format of the file
is one command per row like:

    <command> <object> <objectpattern>

<command> can be "include" or "exclude", <object> can be table_data, index
table_data_and_children, database, extension, foreign_data, function, table
schema, table_and_children or trigger.

This patch has gone through many revisions and design changes over a long
period of time, the list of reviewers reflect reviewers of some version of
the patch, not necessarily the final version.

Patch by Pavel Stehule with some additional hacking by me.

Author: Pavel Stehule <pavel.stehule@gmail.com>
Reviewed-by: Justin Pryzby <pryzby@telsasoft.com>
Reviewed-by: vignesh C <vignesh21@gmail.com>
Reviewed-by: Dean Rasheed <dean.a.rasheed@gmail.com>
Reviewed-by: Tomas Vondra <tomas.vondra@enterprisedb.com>
Reviewed-by: Julien Rouhaud <rjuju123@gmail.com>
Reviewed-by: Erik Rijkers <er@xs4all.nl>
Discussion: https://postgr.es/m/CAFj8pRB10wvW0CC9Xq=1XDs=zCQxer3cbLcNZa+qiX4cUH-G_A@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/a5cf808be55bcc68c3917c380f95122436af1be1

Modified Files
--------------
doc/src/sgml/ref/pg_dump.sgml               | 117 ++++
doc/src/sgml/ref/pg_dumpall.sgml            |  31 ++
doc/src/sgml/ref/pg_restore.sgml            |  80 +++
src/bin/pg_dump/Makefile                    |   5 +-
src/bin/pg_dump/filter.c                    | 471 ++++++++++++++++
src/bin/pg_dump/filter.h                    |  71 +++
src/bin/pg_dump/meson.build                 |   2 +
src/bin/pg_dump/pg_dump.c                   | 118 ++++
src/bin/pg_dump/pg_dumpall.c                |  67 +++
src/bin/pg_dump/pg_restore.c                | 109 ++++
src/bin/pg_dump/t/005_pg_dump_filterfile.pl | 799 ++++++++++++++++++++++++++++
src/tools/msvc/Mkvcbuild.pm                 |   1 +
src/tools/pgindent/typedefs.list            |   3 +
13 files changed, 1872 insertions(+), 2 deletions(-)



view thread (2+ messages)  latest in thread

Message-ID: <E1r8LRQ-007oSu-3G@gemulon.postgresql.org>
Permalink:  ../E1r8LRQ-007oSu-3G@gemulon.postgresql.org/
Also on:    postgresql.org/message-id/E1r8LRQ-007oSu-3G@gemulon.postgresql.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-committers@postgresql.org
  Cc: dgustafsson@postgresql.org, pgsql-committers@lists.postgresql.org
  Subject: Re: pgsql: Read include/exclude commands for dump/restore from file
  In-Reply-To: <E1r8LRQ-007oSu-3G@gemulon.postgresql.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox