Message-ID: <95bb0c6c21a2a96a526a5ce01f16e62ea4f073f5.camel@ucll.be>
Subject: Re: viewing connectioninfo used by subscriber on the publication
 server when inactive
From: Wim Bertels <wim.bertels@ucll.be>
Reply-To: wim.bertels@ucll.be
To: Keith Fiske <keith.fiske@crunchydata.com>
Cc: pgsql-admin <pgsql-admin@postgresql.org>
Date: Thu, 14 May 2020 16:22:27 +0200
In-Reply-To: 
 <CAODZiv5J2op7t5_P-6gQwKXVefmFXV9WhLPtN159U_PbyyM_jQ@mail.gmail.com>
References: <25037dc66dadcdd61148f6d59208217441abfd80.camel@ucll.be>
	 <CAODZiv5QMzAd5_ckxMMfxv84Y3YeASX9ePF3k1u1ERnRKgmrEw@mail.gmail.com>
	 <5f77a6c973aaf8f9086cf42933f476e5bd9a948d.camel@ucll.be>
	 <CAODZiv4LpJ+RfkfesjC91w446hjA3Hhsk_9-TG=cVO8h-0ihLQ@mail.gmail.com>
	 <562890eff48a048d4b09d23f76506fceb867a31f.camel@ucll.be>
	 <CAODZiv5J2op7t5_P-6gQwKXVefmFXV9WhLPtN159U_PbyyM_jQ@mail.gmail.com>
Organization: UC Leuven-Limburg
Content-Type: text/plain; charset="UTF-8"
User-Agent: Evolution 3.30.5-1.1 
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from ptr-7u36h5k51lesqlynxiz.18120a2.ip6.access.telenet.be
 (2a02:1811:526:1700:60e:3cff:feb0:7f7b) by
 AM0PR07CA0002.eurprd07.prod.outlook.com (2603:10a6:208:ac::15) with Microsoft
 SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3021.12 via Frontend
 Transport; Thu, 14 May 2020 14:22:28 +0000
X-Originating-IP: [2a02:1811:526:1700:60e:3cff:feb0:7f7b]
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 9e5a28c3-1a43-48bd-80d7-08d7f8123b5f
X-MS-TrafficTypeDiagnostic: AM0P195MB0419:
X-Microsoft-Antispam-PRVS: 
	<AM0P195MB04193E76B979DE63EFEC7426E3BC0@AM0P195MB0419.EURP195.PROD.OUTLOOK.COM>
X-MS-Oob-TLC-OOBClassifiers: OLM:5797;
X-Forefront-PRVS: 040359335D
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: 
	ZpZMkd5niLea5lgzOqJKTMc2k07N6baOzNNfjwSH8ojxKIUYAISNltE4k25k0eicbug8IOrhGHYjV0w350JnxdCbOjb4TOle5hPiR4a/AjyfkXaVA+lWOCsWgc8IIRizJB2tbeoZjYrT1Nh0pJ/FXJDE0wVInS7XtBh+CUH+q7nraeLYbKahyMC11QZg5zBsEOEpt82pWgKYo+l3OlBecVJAnTnkk09kWwzxwG8wMQKUyXFovycmfIXxHdYpZH/kqZI4bLx0SthIEUhhCQGIjer7YBjjtWkJsiI3MukdSf776BxSbbDdmFWp+t0en5muBRLHYeeBNGUQGnyKSF73Yjsr7KWs0vUae86djaJLjW3j16Qw++P96SB3b2nt6HWM+mixiGsP9FN/pBr86alZ23FwKcltBC8k8OkZ7dhq9hMu6GMgs2rhr1jNoii8OQRo
X-Forefront-Antispam-Report: 
	CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM0P195MB0324.EURP195.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFTY:;SFS:(4636009)(136003)(376002)(346002)(366004)(396003)(39850400004)(6506007)(52116002)(66556008)(5660300002)(66476007)(8676002)(2616005)(36756003)(66946007)(8936002)(6486002)(478600001)(2906002)(36916002)(86362001)(44832011)(4326008)(786003)(16526019)(316002)(6512007)(186003)(6916009)(3450700001);DIR:OUT;SFP:1101;
X-MS-Exchange-AntiSpam-MessageData: 
	2j+D1O85DuTBe3jCTkXNnHiGB2VWbS4r4rsm8G554+5MY1V+K1pnaj/4KdIBfmON/ycuRRNBLRHvalA43QAXMvosxKVoPZxBYPMyDAWfclI9z8WrEO5m2lK72145cgFsY3EC8h8UkzRW1Ge9Zf2O7gxA99MLBDGFOr2zrMv3+GBf5BK9IF5Qd621fHim0f3Jg5G+Nlkq5GiOzAnU2rEX7W5z2OgOue/nyOoo4b3DyQ+yvAonzOPxiv/W5dBJKDbfEor454qnsGS+KTCFvRSWFwOF2sLfDcuQLEPRJUzXGPJ4HGckt2Ry4WleCC6mAAeBGpoZGdzJNJYcPOzgO8+ahiljC5npeE/QrEKLuQFAAhLaifxOgHG+ZA+6V7bchOvnMQk0thv0cGoz61KDUDdTcgjByV9f7ceyG3LDyaTCPPFpqzUCcmWV5uJ0jUFejOhvudX6ef8FxEzbIeifx1sOLugDbEBYJ2edpwK3qOxkAdMFwxIxH4m/UOqMHKqZl6K/BddYModMxgFzlzv75eHMb30hWoiv6uLvoZ0sQEP0Nlk=
X-OriginatorOrg: ucll.be
X-MS-Exchange-CrossTenant-Network-Message-Id: 
 9e5a28c3-1a43-48bd-80d7-08d7f8123b5f
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 May 2020 14:22:28.9156
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: e638861b-15d9-4de6-a65d-b48789ae1f08
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 
 TjIO7FwHB0O1pt2EZg6/4l+lrAcF5rurJAcXYP9IgSHr/k2bXWcivHqiLPY+nySsetALEbOJE0uMyLPstnIG4g==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0P195MB0419
List-Id: <pgsql-admin.lists.postgresql.org>
List-Help: <https://lists.postgresql.org/manage/>
List-Subscribe: <https://lists.postgresql.org/manage/>
List-Post: <mailto:pgsql-admin@lists.postgresql.org>
List-Owner: <mailto:pgsql-admin-owner@lists.postgresql.org>
List-Archive: <https://www.postgresql.org/list/pgsql-admin>
Precedence: bulk

Keith Fiske schreef op do 14-05-2020 om 10:08 [-0400]:
> It doesn't matter how small the dataset change is. The same WAL
> stream is used for both logical and physical replication so it has to
> keep all WAL files until all subscribers for that publication have
> confirmed they have received them. If even a single subscriber goes
> offline, all WAL will be kept until that subscriber reconnects.

That is interesting, i assume this the WAL for the whole cluster, as
logical decoding is then used on this WAL for the logical replication,
do you have an estimate of order of magnitude for the all WAL files?

So far this seems ok over here (with one subscriber inactive for 2
days):
# du -ch pg_logical/ pg_wal/ pg_replslot/
912K	pg_logical/snapshots
4,0K	pg_logical/mappings
924K	pg_logical/
4,0K	pg_wal/archive_status
81M	pg_wal/
8,0K	pg_replslot/db2_sub
8,0K	pg_replslot/db2_sub1
8,0K	pg_replslot/db2_sub2
28K	pg_replslot/
81M	totaal
this after two days of replication setup. 

assuming that students will be offline for at most 2 or 3 days,
this seems ok?

-- 
mvg,
Wim
--
Tell the truth or trump--but get the trick.
		-- Mark Twain, "Pudd'nhead Wilson's Calendar"