Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tM2ey-001G2F-Ga for pgsql-admin@arkaria.postgresql.org; Fri, 13 Dec 2024 10:12:36 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tM2ev-004dZe-Vo for pgsql-admin@arkaria.postgresql.org; Fri, 13 Dec 2024 10:12:35 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tM2ev-004dZC-IF for pgsql-admin@lists.postgresql.org; Fri, 13 Dec 2024 10:12:34 +0000 Received: from mail-ed1-x533.google.com ([2a00:1450:4864:20::533]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1tM2et-002cg2-OP for pgsql-admin@lists.postgresql.org; Fri, 13 Dec 2024 10:12:34 +0000 Received: by mail-ed1-x533.google.com with SMTP id 4fb4d7f45d1cf-5d0d32cd31aso1886932a12.0 for ; Fri, 13 Dec 2024 02:12:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec.at; s=google; t=1734084750; x=1734689550; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id:from:to:cc:subject:date :message-id:reply-to; bh=jpKzSTKxfcoKjtpQmkZLNTKQhSiBuqSpPkkKk53T4FY=; b=KMbqjekx7QPVq8/86jkS6wleKHgjMTw5EzvBK/VADb/d9MbeczxlXcwQBjAirYHW8Z XNpO/EZ0j9eI7AFkq9pk6cYG3RWfyWhtDUJ6M6+JrDLTdw1aZ4dPOWe5qXopj1thVEAU B5f9KvN8bur3a7XWiILaOccg8X7AdrAdsPNxwiLErSKQv4nCx2bxA935TLpKoG9WWdPG hWRfqhYYqS+sUZJNBuUDS6ocBeiieipwpn2BPyA5BIS5mrCDGmzDgZWtHgDOBveelsRc evQ0gPVbWkKCwTlrH/ZfRDGS23/mEqqwggaUili9XwRf4Ih9vSEa/TaELG/7pP/WuQ3k 9glQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1734084750; x=1734689550; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=jpKzSTKxfcoKjtpQmkZLNTKQhSiBuqSpPkkKk53T4FY=; b=u2FB9pui0j1dW2AF5sg+gfWQVLIh+L/JwRZZ4qjyEpU1zYnvhMWEJ5ci5Oh3Kmb43u PJAYqi2TXNVMY68F31m7sjwKbZ4m9khq4AE1o6vKneu+qqwSzwPuR0hpLx+9q6fROs8W OzLXAdPZopMmJeT3f+s8Rg/DpvvnVKauVd6tx90KqwV0aEueWAHYLBaBM0xmNjBak3k8 dz4P3UnJwFgNiRrTw9wlcpV96jvojIOAglIl46iCWNP5fNLqQ5mXu8iRFVUcVen9o03P dDA2lyiLiJIxvixnJEXJK65oI/zC1XVsgYfC3wIZVHiOw0hYTuGz8ehWXAW0E+pv24l4 dbOw== X-Forwarded-Encrypted: i=1; AJvYcCXUzhdUl01stBnqBiZFWXsY7UMSa+6shpUkgJTnNER0HsFa1n6LsaO4SLuPqUKo0B+ivXSDhbylVZ2Lkg==@lists.postgresql.org X-Gm-Message-State: AOJu0YyWR1acxPqJml5PLSk8ili1dAJswb7UjIGb9IpDFxvITeSoQo5e 1fDyaa39u8S+A9J9BGv1NqkAoslbU2WLSHjiYTSedBRIKVocHWaQgehvdOX12EI= X-Gm-Gg: ASbGncvgMbgdXd9odJ32PtLpw6ZgEi6vh8ND1dSwlbAAHef4CP7HIGQAdBo+iquKbAX 0rP9MITVlqFqB3JuhemnrKITXZ9YOB7vxKctQgNBINCaGSHuzMjwlI+TpM4d/PQ8/+fujG4h42H 6BGjN9EiKs2hyyVj7jdpFXtVJpeBfQhJlpdwj9/ccC/nqslmwfPTao+wktlpX44ayZ79kGNCMis 4AWg0cwgrFGjJLvu4gWe8e2ZE+03XMzbXIjt/XoEx5LTIJpa4Gm1DiFRX84tNi/2As8d1I0ug== X-Google-Smtp-Source: AGHT+IGZT+XUi1PHImBspsWNeUj9Xdw/OikYCuCb3+ZvbGZztItOoew5B8wbnnkjaHMolu9sodejRg== X-Received: by 2002:a05:6402:1e96:b0:5d0:d491:2d5e with SMTP id 4fb4d7f45d1cf-5d63c300d72mr4568683a12.7.1734084750502; Fri, 13 Dec 2024 02:12:30 -0800 (PST) Received: from localhost.localdomain ([2001:871:5e:d1:b9bf:ae0c:b5cb:b676]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-5d14c7aa842sm11248375a12.83.2024.12.13.02.12.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 13 Dec 2024 02:12:30 -0800 (PST) Message-ID: <4c4820935c4be3f3df4a9b18258b459b12145b94.camel@cybertec.at> Subject: Re: VacuumDB generating huge WAL filed From: Laurenz Albe To: SASIKUMAR Devaraj , vignesh kumar , Pgsql-admin Date: Fri, 13 Dec 2024 11:12:28 +0100 In-Reply-To: <1727122332.1852194.1734084231873@mail.yahoo.com> References: <155477463.1496353.1733983706261.ref@mail.yahoo.com> <155477463.1496353.1733983706261@mail.yahoo.com> <1727122332.1852194.1734084231873@mail.yahoo.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.54.2 (3.54.2-1.fc41) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Fri, 2024-12-13 at 10:03 +0000, SASIKUMAR Devaraj wrote: > > When we are running vacuumdb for our database of 1.5TB it is > > generating approximately 60GB of WAL files? Any way we can > > reduce this WAL file generation? > > We were able to identify the table generating around 40GB in > few mins by vaccum process. It is partition table with dead > tuple less than 0.5 percent. What may be next steps? I think I told you: increase "max_wal_size" and enable "wal_compression". That should reduce the amount of WAL. Yours, Laurenz Albe