Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tKei4-00A0dh-HC for pgsql-performance@arkaria.postgresql.org; Mon, 09 Dec 2024 14:26:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tKei0-009Gsm-7M for pgsql-performance@arkaria.postgresql.org; Mon, 09 Dec 2024 14:26:01 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tKehz-009GsA-Pq for pgsql-performance@lists.postgresql.org; Mon, 09 Dec 2024 14:26:01 +0000 Received: from mail-pl1-x634.google.com ([2607:f8b0:4864:20::634]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1tKehx-001ttR-U8 for pgsql-performance@lists.postgresql.org; Mon, 09 Dec 2024 14:26:00 +0000 Received: by mail-pl1-x634.google.com with SMTP id d9443c01a7336-21644aca3a0so13077185ad.3 for ; Mon, 09 Dec 2024 06:25:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1733754356; x=1734359156; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=asGxrwZ0msUZECYyOj3IUES8rpBgT/R95PDHFM7NjOE=; b=dCIwssFlIzm/qu+Ro6nLTaTXCs0Cx1YNUFVZmphjZAQQc2PUiy3/+zMm9ll81y4iDj ipC9WCBscU4oXgWPXX7o4fhpd2WeH31i7xv+4mt0ku21ZW3dr5v8LqRr0+SNzNQq2fUY LRwSLYaAM5lkeW6KH3OjXvzohxm9sZtmX/AQGxCxjXO0kLbz453ghS3EDVypu1TM4KGv QAYiS9gqGRXo2Hkn6EXVyzjYnBwtDmyTkMORzKZtzYuLeMVXUrb6vPXNx7kxLnrarlGm 1oJDkcjOP+c5OpuzaV3/EtbacguSw2KESAW1TfUtWoRD9URrEJ5C2iBtovvdvqtUnSe4 Cyow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1733754356; x=1734359156; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=asGxrwZ0msUZECYyOj3IUES8rpBgT/R95PDHFM7NjOE=; b=VjBOy6x23EDbHtyzK2kkofi9VShIHr7sR85L1i08rDShfb2c4DuLLo+S8hUR+n2uPP Cv15fY7vtLRoH6Ih4VRfrV0Kf8T+9DTcyTp/tz0SXtCh3wjmJrNfm0u7r2W6hkXGo+Ip 5RoeLUnsYX8hPlv8VGOIt+wnsH7cC0LzLbSvSjLkKTRq6j8PD2CttdEjOa6mo8JAa+se PVV9CRa2ZuPyyahgaWdrEpc/TqoXUusBkytfHCT2NxDOtDUnqCtML1e+DJqAwWK6hIbo t9vOTxg2RsBaoWSmvzPp1/8MMQeLr93VxTPlIHqQdF+zFFLw9nxXRrmZbhJoN4R9WUqG xY8A== X-Gm-Message-State: AOJu0Yx+hgE2Y8Keac3sCasce64GcHpJwbjEMpaHLu+4DyES5VjsDzw7 BIMKB5tdbW71ZbhYUKfTr4XAu3ylSmmxjIO+631Y0Np45Q0ew6QzqMSHGpVAtdxBR6Er90/IcRL TVyfFqooiPjScaqufJXrDWUYAMOtc+A== X-Gm-Gg: ASbGncteCfGnnNAMCzF3etPpHR4MTKF0hHPUUTc29u2EpqYmK7T0RY7D8pD7c+8oUz5 UyLT4nJcPL80+7OZP4dBObWw5lsiHplzQ4QRvMwISZbLU70AuHm7oWS1nQNC6pALE X-Google-Smtp-Source: AGHT+IHecqn73z8LxRpjkJAZlDooZXRRc8hVL/Dv1jlD4HKFESQJZ0ICFZTpxIR016M/XbhLWzMaeWd/uAXKWAFZ2ig= X-Received: by 2002:a17:902:eccf:b0:216:2477:e4d3 with SMTP id d9443c01a7336-2166a09b0d0mr10446945ad.51.1733754356035; Mon, 09 Dec 2024 06:25:56 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Rick Otten Date: Mon, 9 Dec 2024 09:25:45 -0500 Message-ID: Subject: Re: PostgreSQL and a Catch-22 Issue related to dead rows To: Lars Aksel Opsahl Cc: "pgsql-performance@lists.postgresql.org" Content-Type: multipart/alternative; boundary="00000000000084f9bf0628d7247a" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --00000000000084f9bf0628d7247a Content-Type: text/plain; charset="UTF-8" > > > Yes there are very good reason for the way removal for dead rows work now, > but is there any chance of adding an option when creating table to disable > this behavior for instance for unlogged tables ? > > > Are you saying your job is I/O bound (not memory or cpu). And that you can only improve I/O performance by committing more frequently because the commit removes dead tuples which you have no other means to clear? Is your WAL already on your fastest disk? All of your parallel jobs are operating on the same set of rows? So partitioning the table wouldn't help? --00000000000084f9bf0628d7247a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Yes there are very good reason for the way removal for dead rows work now, = but is there any chance of adding an option when creating table to disable = this behavior for instance for unlogged tables ?


<= /div>

Are you saying your job is I/O bound = (not memory or cpu).=C2=A0 And that you can only improve I/O performance by= committing more frequently because the commit removes dead tuples which yo= u have no other means to clear?=C2=A0 =C2=A0Is your WAL already on your fas= test disk?

All of your parallel jobs are operating= on the same set of rows?=C2=A0 So partitioning the table wouldn't help= ?
=C2=A0
--00000000000084f9bf0628d7247a--