Feedback-ID: i76984098:Fastmail
Message-ID: <7c5b3f29-d82d-4cac-9aeb-8a4c0085ddf2@aklaver.com>
Date: Tue, 7 May 2024 08:24:29 -0700
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Restore of a reference database kills the auto analyze
 processing.
To: HORDER Philip <Phil.Horder@uk.thalesgroup.com>,
 "pgsql-general@lists.postgresql.org" <pgsql-general@lists.postgresql.org>
References: <5910d4dcbe244548bbf482dad0ceca83@uk.thalesgroup.com>
 <4b64d2cc-1df6-4982-b842-39fb0d886731@aklaver.com>
 <545ad7354f5f4c239df25faf8e883e98@uk.thalesgroup.com>
Content-Language: en-US
From: Adrian Klaver <adrian.klaver@aklaver.com>
In-Reply-To: <545ad7354f5f4c239df25faf8e883e98@uk.thalesgroup.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Archived-At: <https://www.postgresql.org/message-id/7c5b3f29-d82d-4cac-9aeb-8a4c0085ddf2%40aklaver.com>
Precedence: bulk

On 5/7/24 02:38, HORDER Philip wrote:
> Thanks for your time Adrian
> 
> 
>> Is there enough data processing?
> 
> Yes, one table is receiving upwards of 20 million rows daily.
> We noticed the problem when fetch performance on this table degraded after updates.
> 
>> Autovacuum has thresholds for turning on, are you sure those thresholds are just not being met?
> 
> Yes we're sure.  Our biggest table is set for a fixed number of rows rather than a percentage, this gets an auto analyse about every 15 minutes.
> 
> After an update this just stops, and there are no analyse entries in the log file.  None at all, for any table.

1) What is the exact pg_restore command you are using?

2) From earlier post: '...  only analyzes tables in the new db at the 
point of reload, then shuts off again.' Provide that sequence of events 
from the Postgres log.

3) Also statistics from

https://www.postgresql.org/docs/current/monitoring-stats.html#MONITORING-PG-STAT-ALL-TABLES-VIEW

for that table after the reload.

> 
> When we restart Postgres the auto analyse restarts and catches up with the backlog.
> 
> 
> Phil Horder
> Database Mechanic
> 
> Thales
> Land & Air Systems
> 
> The information contained in this e-mail is confidential. It is intended only for the stated addressee(s) and access to it by any other person is unauthorised. If you are not an addressee, you must not disclose, copy, circulate or in any other way use or rely on the information contained in this e-mail. Such unauthorised use may be unlawful. If you have received this e-mail in error, please inform the originator immediately and delete it and all copies from your system.
> 
> Thales UK Limited. A company registered in England and Wales. Registered Office: 350 Longwater Avenue, Green Park, Reading, Berks RG2 6GF. Registered Number: 868273
> 
> Please consider the environment before printing a hard copy of this e-mail.

-- 
Adrian Klaver
adrian.klaver@aklaver.com