From: David Modica <davidmo@imaginesoftware.com>
To: Ravi Krishna <srkrishna@outlook.com>
Cc: pgsql-admin@postgresql.org <pgsql-admin@postgresql.org>
Subject: RE: inserts take longer and longer
Date: Wed, 21 Nov 2018 14:04:39 +0000
Message-ID: <decce8b9ed584604894fa18ba2779be5@imaginesoftware.com> (raw)
In-Reply-To: <BYAPR01MB384810591FF49526B5FC486FB9D90@BYAPR01MB3848.prod.exchangelabs.com>
References: <9a645d6c8749483c90f5f109889ea8ce@imaginesoftware.com>
<BYAPR01MB384810591FF49526B5FC486FB9D90@BYAPR01MB3848.prod.exchangelabs.com>
straight insert doing batches of 100. dropping the index to see if that helps.
-----Original Message-----
From: Ravi Krishna <srkrishna@outlook.com>
Sent: Tuesday, November 20, 2018 11:52 AM
To: David Modica <davidmo@imaginesoftware.com>
Cc: pgsql-admin@postgresql.org
Subject: Re: inserts take longer and longer
>
> we have a developer who is doing
> batch inserts 20 at a time and each subsequent batch is taking longer
> to the point where it is a critical problem. I recently changed the
> out of the box config to see if that would help but it hasn’t:
>
I recollect reading something few years ago, but not able to place my finger on the issue. IIRC it was something to do with the inserting session creating a HOT bloat because vaccum could not do anything on that live session. I will try to search for that post. But the symptoms were similar to yours. Initially good performance and then getting slower and slower.
Q: Is it straight insert or you do select or updates also along with insert.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: davidmo@imaginesoftware.com, srkrishna@outlook.com
Subject: RE: inserts take longer and longer
In-Reply-To: <decce8b9ed584604894fa18ba2779be5@imaginesoftware.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox