Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sR5V5-00DFKC-3f for pgsql-general@arkaria.postgresql.org; Tue, 09 Jul 2024 07:42:59 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1sR5V3-00DvF5-Au for pgsql-general@arkaria.postgresql.org; Tue, 09 Jul 2024 07:42:57 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1sR5V2-00DvEx-P3 for pgsql-general@lists.postgresql.org; Tue, 09 Jul 2024 07:42:56 +0000 Received: from mail-lf1-x12b.google.com ([2a00:1450:4864:20::12b]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1sR5V0-001BSW-3H for pgsql-general@lists.postgresql.org; Tue, 09 Jul 2024 07:42:55 +0000 Received: by mail-lf1-x12b.google.com with SMTP id 2adb3069b0e04-52ea929ea56so5819426e87.0 for ; Tue, 09 Jul 2024 00:42:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec-at.20230601.gappssmtp.com; s=20230601; t=1720510973; x=1721115773; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id:from:to:cc :subject:date:message-id:reply-to; bh=nD4/mQUxU5yVSuvcWjT6CKlquTNMBHhL9wEqhC14OSU=; b=CeMBCkz8BZtCiZJIS+3OJWvrpeWgYmDGpxflhlS8f9m5K5EtMr7W82eazSO2m9P3JN GtVZ1UZNFlqZByT8R54EbCtDNDiDDwm+SPDmyxslFYTauClwpS30n83SXc1bksCvw1mf UKkMBAywZZMuGDS/i8h+xHwSmX+jnlGy0EFo5+1C1cvhe4b33301ZKIzSDdVPpxfz43e mtD/QFhytJvs8gr7XaTLILdv58MCuabQcg+h+j5Xz1Niz/LkrBhha8PX4ycWb0Rad1Xc Edx2pvosfs1wK8+vH3J2FelAR5P0uzwzWfPJGXpQDVRFWBq6qKpBGMeT8hAmpZKVezwC 36EA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1720510973; x=1721115773; h=mime-version:user-agent:content-transfer-encoding:autocrypt :references:in-reply-to:date:to:from:subject:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=nD4/mQUxU5yVSuvcWjT6CKlquTNMBHhL9wEqhC14OSU=; b=GHMyMMeJxVODcT6gAQ+cjvuO/184J5hu9ijFmd+O1CEsYhU/FVbseMH3r6t1vcOZuZ 4qLvseWjrlXr+6YrwsM/NF6iF4oK0UP0I7bqDEf4CdbLASdPaRqbYhoP8jl5QSG+SgYM DMnLGuGEcP/2E738SfzpCwFDDe88XYHqa+1oSLTOlWSy8mXrywOv+7GTJaziaSS5t2LF f1aM3Lk08udWZXpd0HYu153drllFnknGJb9ktdj1MvVsq/FE8uWdovgBPDEA76Xf7GBC vT6rGYD8k1EtxbId2jlOyKfb1ejm7zGHgoPU1fsqFpB9N+mAAOxmNIjMIXjsYcFfD5UW 0hcw== X-Forwarded-Encrypted: i=1; AJvYcCVlZlNmcVVN+4DeqEcnXLWI4cH1zM24Ymdw1js1XcU2hdrlnBUxiiSejDTfQZgUi3iFf47c3nyUZnFE1TSIIzlqpq1zIcb6244Nmk6BGHFrFZmf X-Gm-Message-State: AOJu0YyPzBGvaAKosNaa95ZENH3+ABZJ5+4bE5+VoiS/v9XLbpQG7zy0 7gfiirqFf3vZzlW+4ojelk18tWpi6s/Wssc9TskhkY/kBpSq/6I4iMMUo2JgcuvQFCJN8D7cees pJig= X-Google-Smtp-Source: AGHT+IFoxOTvByDTbTB7ytE1EAu/N89UFjQypOcATzYhw33cfkocCcWfCKX6qIC1Qf/sLN9KsYgZMA== X-Received: by 2002:a05:6512:10ce:b0:52c:e091:66e4 with SMTP id 2adb3069b0e04-52eb99d2898mr1206423e87.44.1720510972619; Tue, 09 Jul 2024 00:42:52 -0700 (PDT) Received: from localhost.localdomain ([88.116.133.170]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-a780a871ebesm54868066b.203.2024.07.09.00.42.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 Jul 2024 00:42:52 -0700 (PDT) Message-ID: <8b77f9ece694ada85ea64c90d657f0ba4d515100.camel@cybertec.at> Subject: Re: Logical Replication - PG_Wall size is too big, What can I do ? From: Laurenz Albe To: =?ISO-8859-1?Q?Jaur=E8s?= FOUTE KUETE , PostgreSQL General Date: Tue, 09 Jul 2024 09:42:51 +0200 In-Reply-To: References: Autocrypt: addr=laurenz.albe@cybertec.at; prefer-encrypt=mutual; keydata=mQINBGGDwAQBEADgbWy5cKXQld3N2mF+DFyiNFbi2oBl2T+XgxpPF8wTRw2D/u4bBKXP0SYSE/lA86jIVNWWU0gf1KODIkVvgJm2w4vH2VBV1b7ddVViGl1Iu+9zaRnv9wulhnH42KefepXnoean6UT1EzLM0opF/Ik0j+40TxdRtobkBprkQUyHDXWlHc2ffPs3SipyFEP9AVLf7ejRC46CXWDnsqjOBSMEW8Z4HiK/8RrPZBsKLts8dJxKF4pygOdJb0CWk8k/X1jbcfdxo+zOLjOMvJcSJ2pFdJmQHU+JufB3rePziqQ2S9Ur6sccr9XnTC1GVBWN4Lf5VHq+vf+bFJjVwg+2hrySZnAVfcOrxoqFLErr7ug1zN2nM1kcpgA4VWn4gxlJtYNYYq+9WxX5dtvnNANlG3ZCrRKQzl8lxtzoF6Zo7LUhEqPaHDwn7Rvs+IdbOn41lF5UDTJGqmC4gS/bZydW2Fy3YWm4aSaN9fgFf8D+PVkrlKAZB7gBLz1TyHjbcRf85cYF+GKKrDld5SzMB/V60VX3oP/Eo8ikFpyWaqiz1f9X7MBot3/PjJkY+wDzp3nmb19QEcOBuQiSQ4xds2r0HewbuHTAR68u8jNNMGmpm2j4x+g09Jd/WQDjqlTBZ/jEltH41fYCCPWMfljXTOOXu2eLNGdfi7ETZogtwjM9oTtSPQARAQABtCdMYXVyZW56IEFsYmUgPGxhdXJlbnouYWxiZUBjeWJlcnRlYy5hdD6JAk4EEwEIADgWIQR0CqhbZGGABqoaSbdi8bhXA2EdmAUCYYPABAIbAwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRBi8bhXA2EdmM/6EADK232JCwmBzhlj8h7U9CjG6kx0JHP3uJGv+XfsHtHAlmY/RCwF1BHMEsRlk bT5UrLvJ2jb99bA9QARzhFaxzyn0F/BUKzuIjRGNs/n6d5dNUFA0kOt8sX+TacmC GEyjEBCrVCm4ranBiUyePn9NhHNWnaex7pJyqvMLLdwW9BEMJx0Fqo+DN8ukbXmYRsmhEtd3ue+x/luYmOmJnaGtzInaY5aOJYbW9XqoRIZkZvOCgbi1FfvNmoqWa+3oVxTOgw9RafjJDyW0lTHzKGjbGI5ofMU98l+/hKJFYJqWUF6VpFJY5YIcN/1lf4ZICMwDl+MPIVo/tpq8L10seJL28nLlvw3K+cI+TVW8IW/qL/LyVoDofI3USeOORuYmhpWRhik8JXX6xf3v6GrRilJIPWNFIJbxm1ZblQiQnOw3IOW7T+8nAmPin1HKqM3VrOrJQ2VtShsefNBibNAsr1oFaqcDBkn3yGG8i6CTW+FyO4PZ+/EwNxMVgktxbYdy5AT1/lpXr5tB+phhLIyVfiBvrWs5EThxYMQ/L8Y85c3GMsAy1l/x4h3jqySIYy3SCU9+jc5UVuNnXljbvkEzJ+NLWJ6C1rACFWrMszgPdh5tCrlRY9PpmYll4JbCgb8BtxEIUmR+xr50/ZElEK5iml7Q00KUekCcDt+36PsyGFTXBzNOrkCDQRhg8AEARAAzOZ2tLHlI4rrhG411h6cdCFjBZxuljaFCxFyHn3m6wbGLqwBUWC5k8UrRqjHMz88KcTSaNO7XGAmCqPdWd2SeflPZRnNTbjsVpw7mLdffsBm4JX7kki2Pvk5h0NtYeidXT1PSpc2ri4DutYXuT9uD8RAm1wUDCE5HQNUihT/WH6opt+hskHW21uHao0+y822tG0QQcGMqdQR5Vxdxj89wiEPdqW+HpU/oOZIhrf2E7prduAppxixjHy/o1rcnoznnJvc8D3+YgI9O0LrBMij89dM55pRGbLovTR1oGR3U74sX774+0xmSzeIKwZfiMUz7Atlvfk5SHOsRUFPN2Ux9kaXiiBibQpHFxt7b lDrT4wxdLJ/XCdbPPAyl+lZtOLsaHEEZvYNyTXwZc35dVf3R4/oz20HoG6s7ct8e1 AQygj43XAERzty9SkWgxs8+grp1PrGx6FHVSYRqBM8dS/ZR6yRVwOwJXPyaSSqfIF21DkE4j1y4n+ItSewPGoRp8K/yWCikt6qlkVkO2ASNIiX04fAbtzwVOaNn8ZMRNqyvLc1fED4sr49onE4cAIcBLjcC3KL+w9DUGRQCdziROj5H2Yl/sXGPdMciUHo/Uz2rggc+2th3bQiMhrHWSsBpUkDQp0yWewemstPpPgBL3h2fHKaX8B9oH5Qu/H1IgrOuX8AEQEAAYkCNgQYAQgAIBYhBHQKqFtkYYAGqhpJt2LxuFcDYR2YBQJhg8AEAhsMAAoJEGLxuFcDYR2YuPwQAMkpGtR80pQ1gVsONhdkqj0H2eU66efP/gO3CoyaoIcvrpKYj7C2HipVSmkt1gpByL0X4AMQ/vKuknUz3wd28Ba+G1dCfbVs/Xiusq+SmpUj5rTwmYqdSjWMuCo1R6oS5hdJMdUUJYGMT0QkVlm1KnW8jkmCTl9GzjDxOAsN9O6/6lPzaGFtk9XF+34Bry/N4HKiJkqpC4+UTd0AprPfzJ2jdT64e1F0+W88X8y1bTTgNrHwK4mDiLnlE4SKRuEm54lNhJz//ar86Or5BErzNpM6TL7lk44QS06hwsMrEdKIy8J/SYJPjfzR8tIUnKscclVpOgjKaBqC+0iFiVaRqAgfOlIEiezX6kMh5Q2FIUfqs46qWhhXjRrdKOEoStYAaikdLu5ZXr7vfb0ZaDh+ZwTQtbSMFolyOkecwI81MCdbMfT/1TqIGTOdAj5as9fAakk0jb2pXgUYQ8X1DVTR8ahSDVEaw9VTmWiSvTxvguVJ1Mb7gG4Gmh6aviDTJhfXtH4rPUNXhDLqrTH8JkJjyKROOMakIF68Hjse5vUfUxreBEOtb5r1Coa2Fe7ncJayaSE7ryrDbFqpZ 36UMAx4ulWMyqJajLNGY0DdG8qIsR5nxRhrnK/mrCidZ8F9/D3bWAl4rjtHlsztN59 +AnW5l0HsQcY9ntFL/zEBOaonjdJf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.50.4 (3.50.4-1.fc39) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Tue, 2024-07-09 at 07:05 +0100, Jaur=C3=A8s FOUTE KUETE wrote: > [image showing a large "pg_wal" directory] >=20 > We are facing this issue and want to know how can I do to clean this fold= er without problem. >=20 > What can be the cause of that ? > and How can I clean this folder without stopping Logical Replication ? The cause is logical replication (probably the initial synchronization of the tables), and the only way to clean that directory is to abort logical replication. PostgreSQL has to retain all WAL (transaction log) until copying the data is done and it can actually start decoding. One way to reduce the impact is to add tables to the publication one after the other (and refreshing the publication each time). Copying the data for a single table can finish faster, and logical replication can start catching up sooner, so PostgreSQL doesn't have to keep so much WAL. Yours, Laurenz Albe