Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tLkmb-00Gm7H-Cf for pgsql-admin@arkaria.postgresql.org; Thu, 12 Dec 2024 15:07:17 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tLkmY-00Cv3T-JI for pgsql-admin@arkaria.postgresql.org; Thu, 12 Dec 2024 15:07:15 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tLkmY-00Cv35-4F for pgsql-admin@lists.postgresql.org; Thu, 12 Dec 2024 15:07:15 +0000 Received: from mail-dm3nam02olkn20828.outbound.protection.outlook.com ([2a01:111:f403:2c05::828] helo=NAM02-DM3-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tLkmW-002Svf-Nk for pgsql-admin@lists.postgresql.org; Thu, 12 Dec 2024 15:07:14 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=K2+tOv/iT0Y/KPf9lIf+MsxrvRTUnIxCB/RSJ6ADfFsQIp6pP+ZbqLz8elgvBX9PMaRiVscb4vsDxwyJSztXPpVf7BUMfc+TpWOugE8hEv89OwapqqkCftmO4UyTcyI6Ka68F5vNCu2jaKywwn0D4kzTeVpwgFLYAHdUA3T/F4ogJpZRFygUbb/8zdzCDKVdcwmJi0nX4gx86G8wZr859FywbU40YOS8ZMlG64H5E3rg5IFiY+39YHwV2Sz7eEXCA/YIq2N9u6NT58MHp3bSxS40YYDHiXRVjVx4/OSI8QuEfFZSwKwDKEA42HlXtUKid4dd2RovfwRPSk9KGYIT/A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=/KzXUyaXY9YUftxpcaK1Wau83En4sP7Y8qC5lP8ooEE=; b=ItRl+shoIMHsh1+eTfylbSgwRfMdpj2b0cxa/oJXiOJtNNuCoFddFFCCQexDoyfqS+vMo95IdlZOxJX6x3w5VbgvSSK3LIMz6FzXIPJLB6NQnkwyCzlaiL2TyIr1rhDWOQITfhD8ttti7Zj3fEEghTk9Jtxi9Rc1P3f9QilA1stBE7n+H8NvGnhk/oQhshKbgeYChc0JhfBHNOo8dQEUcvEpvb95qODpAceDjgUDkcOtVZEWaVMlwSGMbuthSCHWGeUAwUdTrf9cE8YVf+jos+tlYHcqTOM7W9ayrSzjuqEPvERYJKRgusZu8HRKJ1nkBtD3T4UeE4gLts79OuklRA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/KzXUyaXY9YUftxpcaK1Wau83En4sP7Y8qC5lP8ooEE=; b=qFG2DhEZaQpHkaV9ggN+BC7Rx6/zVz5Z9YNjPa+fHrOc8xK4BvBsnymau/8EQSOcUMkRdOujspglxUGyIvS7AHVsiVtm0aCT51FBimwn+YGGLlJxYbDhAGMTCiE2cb+mSTYnVrbZk8IaBFbf7oynMWc9X1XpE2u3RURAReqbQ7Sd8kAwpqRHXtmFJQ/FTeniKSPruvLrBkcFxO5/cOJm+2w7Cn4U8ipB6sPsl1IZyvyCx5vW+rsfHsiBCFmGq8QoB1r2KDrOQ9ICFBvEioa/KnQjCylIGA+EdIW01yc+d4dwdxxvWXdTdT/V+nIiTloRszwrmydPGwDi12bHKGksEg== Received: from MN0PR20MB4912.namprd20.prod.outlook.com (2603:10b6:208:3c0::13) by MW5PR20MB4426.namprd20.prod.outlook.com (2603:10b6:303:199::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8251.15; Thu, 12 Dec 2024 15:07:10 +0000 Received: from MN0PR20MB4912.namprd20.prod.outlook.com ([fe80::2b55:f111:9de9:3cd9]) by MN0PR20MB4912.namprd20.prod.outlook.com ([fe80::2b55:f111:9de9:3cd9%4]) with mapi id 15.20.8251.008; Thu, 12 Dec 2024 15:07:10 +0000 From: vignesh kumar To: SASIKUMAR Devaraj , Pgsql-admin Subject: Re: VacuumDB generating huge WAL filed Thread-Topic: VacuumDB generating huge WAL filed Thread-Index: AQHbTFygJoZ6b4Djq0+LP3fLbameErLitdQe Date: Thu, 12 Dec 2024 15:07:10 +0000 Message-ID: References: <155477463.1496353.1733983706261.ref@mail.yahoo.com> <155477463.1496353.1733983706261@mail.yahoo.com> In-Reply-To: <155477463.1496353.1733983706261@mail.yahoo.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-reactions: allow x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: MN0PR20MB4912:EE_|MW5PR20MB4426:EE_ x-ms-office365-filtering-correlation-id: 682f672d-f778-4341-52d9-08dd1abea704 x-microsoft-antispam: BCL:0;ARA:14566002|7092599003|461199028|14030799003|8060799006|19110799003|12050799009|9400799030|15080799006|8062599003|1602099012|102099032|10035399004|3412199025|4302099013|440099028; x-microsoft-antispam-message-info: =?us-ascii?Q?Bcp056VTBLXpJMfLlOWytG+3beA4fX71Vq4xCThQn8oeMCcUziaZsLmqEo3O?= =?us-ascii?Q?0JE6GT/b9JdrFvG5MkmHdkYeh86lxmrOt7H4UGOSKJ3wYTUYOkG3prXF23di?= =?us-ascii?Q?HI/c6PQbn5OLZb4Wx6XteL2FVG3ezYcsD2Fn1/gTyO1KXON1ghR/nayQ9AY6?= =?us-ascii?Q?H8jI0gs+CcmH4VPGOYN2b+VabuW6SmdNiN8iMkBm+CxZKsFpDsb4VFni1Fug?= =?us-ascii?Q?a/z6UT4hkfwGZuwtRXBjBdwHfzXxF9Xd3NQNlN+AUoBN8BFixlIU6eg3fP9W?= =?us-ascii?Q?Mz7vbDrykGP8WWuQAkjbOApFJd4a4pjUbtQe9SQ9u5WqBv/urvzEjwVlEeDr?= =?us-ascii?Q?ExbRbtUwnuiGUqKcm5sFkB9Qa6B2cFqkDP52+XDMkPOdkhTNAJNwMLpp/nmP?= =?us-ascii?Q?U/g66A7Opzigs5wVgkgSy9oGH7NAMrq+KRPArZmJxWR+/AOcMWIGmWv663V0?= =?us-ascii?Q?U9SCBbIvA/GVyfcs+TxPZPipxFgcOS9t16Gr8eWG1LDU9W2BkY8yIO+XIZyk?= =?us-ascii?Q?ngcYmWLGToRRA8MSAiQPAoikODC0yypfce+gBLwZeUhJgQxRTy0cCWQXaoR/?= =?us-ascii?Q?2EKSfkJQGJK0wXZi7G4MePV8ID9zAx8FdtfsACxc41og+VvDXw/hEJR4yTKG?= =?us-ascii?Q?jSWv4MFKIXNdLu4kosHbRwtuOgjr3ar4R/0ALViHxX7agEx8t7V87jj1G1kh?= =?us-ascii?Q?mDPULBTT65on5gL7aUxSgyo1jxc9oha0rDNQKA2/pCJdsv6aBO24sQrqfdZS?= =?us-ascii?Q?3bJ2ON8QXbdDETgMWeEnX1h53iv+ujPj51MrClaqeIcRr2TXptZ1B7FppVHx?= =?us-ascii?Q?EKzeXSMCTg5JVjftBzZu60+fTfsecBmcUaxFLkR3hxc3IRzF2YeDaKfA/v3M?= =?us-ascii?Q?KnP4mQpzpz+qoN2ftHyXij1IeCVhqDxga/mAe6l75/6ZeYAGq3TNrNuBOf5t?= =?us-ascii?Q?doKHHJ/2epepgpju3Wg6+H8yLrh62AEo+siZis7VbF2CKGnrdk2vvl4Of2Fa?= =?us-ascii?Q?HjBPQXxfLCgXuuabH9I4K8olrc8IFmmtWKCqFYeNQW0GwKzgk8jMxjmJjzbS?= =?us-ascii?Q?wgJpiYmgR7c52GCOTnCF+122rftEZPtXFhAHIPN9q2xGwtb4Hn/4v/uLyQVI?= =?us-ascii?Q?ThPu0neZGuDgSP7TImmelBAr/Ugugcf5VM79aCNWKgZhevyWiflIRlFV77Xp?= =?us-ascii?Q?Z5fcI0EL5dlOOX39GH+sqvZxjmeMAhvHXJctGd8j7/5KvXBvJ6QivvPb/ObG?= =?us-ascii?Q?MJ2Q62Y/cNCZMHYkR0Yx?= x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?E3hHHxRQgTbcKIzGXZRaRDNvqWDzHZGK6ININOXtjbVQXBjDwQhAJbRQJ1HU?= =?us-ascii?Q?x506ecVr8EaDFqb8xfuraUvAuUv6CTwjgWZgmin4QxvX/sXlcWvUqD5QFUxm?= =?us-ascii?Q?EG6OrsAdpWKXzTaY19tWryNFtYZzNOFe8xswBiNLAuUhuvKE3mY6zVyMS9/6?= =?us-ascii?Q?Ss0gcuKtnOLkOweBuHa6/3x+dfIeu1XBLPAv0WFG8tLC252SVTIkhholDgcd?= =?us-ascii?Q?Ir54jTdlbmDkzMfzCkvQ0+duHfCMzMTLjYJonv6mhrQdfYGDAKP0Ww6KukLo?= =?us-ascii?Q?wwuB3LJyvYanozQdfYU5NM32ChIguVBNVxkkRWxSLCVzHCnQM66zaxK5eDBe?= =?us-ascii?Q?QC6eS03IlZ87Xy9qjBX3RFFtmY1ImhOgFjHmTF529S0gk3Dx8XhQzi1TI9S/?= =?us-ascii?Q?pFYmMmDzhiiQ9b6MZqsjaZm0cUBSQHhK0chiFarsS9jJP/GsL/FQ5xLxMwtZ?= =?us-ascii?Q?3mkjobqZYTagQqBCR48cRQIyyB9gyJGhd5TlmagEq21xEoWWkOG7r1i09ZYV?= =?us-ascii?Q?QFQRcO/nrOpst1cDKQi+3zwSZM0VkeC413YEP2XLJZ5xBB45FVbkPfmGFh2O?= =?us-ascii?Q?nQ88UGCJD/YPMEWskNE+hVWagiKM+m3TSV7jTny4Ao3WaEH4EdHg3/WLBgo3?= =?us-ascii?Q?rt3zzcULxscn7F0GUFLTUQBat02Z4Ugf/cBWo3FPxH4h+EDhjSiozRe0ZQAh?= =?us-ascii?Q?snzdhDgnKEzSnK/1fvmJ/u+B5xSo+kbTt3vcmYqtpZbTS4qss4b5mN2rYOaD?= =?us-ascii?Q?9R3db2Ga+daOxGHcRadvc3g02jkuxJ/VY56nKY0BAaoi2A3kJ1oG7Y/F1mtE?= =?us-ascii?Q?jLNWVRCmLiRlLMzhvfSz5yTIYv+KBCE4XFSX2jBhxink1BlM6gytNOGcZXA8?= =?us-ascii?Q?nx1lPR9MLHY2o2XLuVgDx/5wvYDt2ehJVBq1oTBB67tpFG3uzzbK1H5tweC1?= =?us-ascii?Q?NFuqk5Adb/dHdG4Ytxc88ckzc/rWZY7TfRdNdI+vrkJ5zuuk/+LjzNecgMC8?= =?us-ascii?Q?LLlKcJuHPuV1APSW5HCXvx4MrhrK0pi1i6fPVNc5Z6GQaS6zkiebnLAK/dy+?= =?us-ascii?Q?54hmfK9WAVVElywgm7nkyLvCunVgLEZ5r0rmNP8g1+bRdbDylx6UoWrhtqlS?= =?us-ascii?Q?x1LfCYNW3a7nhnIttHH4KrrW4iLFS2v1zNandjBwecerQ10aIu4Chpw82cwT?= =?us-ascii?Q?g0hTy7GllvS0w2y0nwZGImdMCMC3jgMZvJiTLdNXUxYRmF9ZoOJeY2G6cawJ?= =?us-ascii?Q?Ec3bXLs/RVOFTXF+78p4sdYkgqQRiS+hDL1ZbGhBjJpYNGXWJT1Jsn0MC3qd?= =?us-ascii?Q?Nrk=3D?= Content-Type: multipart/alternative; boundary="_000_MN0PR20MB49129306EE76C40E778EE7A5873F2MN0PR20MB4912namp_" MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MN0PR20MB4912.namprd20.prod.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 682f672d-f778-4341-52d9-08dd1abea704 X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Dec 2024 15:07:10.4542 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW5PR20MB4426 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --_000_MN0PR20MB49129306EE76C40E778EE7A5873F2MN0PR20MB4912namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Check for the max walsize allocated in postgresql.conf and also check on ch= eckpoint completion target default is 0.9 this says how frequent the checkp= oint can be applied that adds to wal lan generation. First do a table level vaccuum and see what's causing it to write more wal = files. Sent from Outlook for Android ________________________________ From: SASIKUMAR Devaraj Sent: Thursday, December 12, 2024 11:38:26 AM To: Pgsql-admin Subject: VacuumDB generating huge WAL filed Hi All When we are running vacuumdb for our database of 1.5TB it is generating app= roximately 60GB of WAL files? Any way we can reduce this WAL file generatio= n? Regards Sasi Sent from Yahoo Mail for iPhone --_000_MN0PR20MB49129306EE76C40E778EE7A5873F2MN0PR20MB4912namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
Check for the max walsize allocated in postgresql.conf an= d also check on checkpoint completion target default is 0.9 this says how f= requent the checkpoint can be applied that adds to wal lan generation.

First do a table level vaccuum and see what's causing it = to write more wal files.

From: SASIKUMAR Devaraj <= ;sashikumard@yahoo.com>
Sent: Thursday, December 12, 2024 11:38:26 AM
To: Pgsql-admin <pgsql-admin@lists.postgresql.org>
Subject: VacuumDB generating huge WAL filed
 
Hi All

When we are running vacuumdb for our database of 1.5TB it is generatin= g approximately 60GB of WAL files? Any way we can reduce this WAL file gene= ration?

Regards
--_000_MN0PR20MB49129306EE76C40E778EE7A5873F2MN0PR20MB4912namp_--