public inbox for [email protected]  

help / color / mirror / Atom feed

From: Adrian Klaver <[email protected]>
To: HORDER Philip <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: Restore of a reference database kills the auto analyze processing.
Date: Tue, 7 May 2024 08:24:29 -0700
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
References: <[email protected]>
	<[email protected]>
	<[email protected]>

On 5/7/24 02:38, HORDER Philip wrote:
> Thanks for your time Adrian
> 
> 
>> Is there enough data processing?
> 
> Yes, one table is receiving upwards of 20 million rows daily.
> We noticed the problem when fetch performance on this table degraded after updates.
> 
>> Autovacuum has thresholds for turning on, are you sure those thresholds are just not being met?
> 
> Yes we're sure.  Our biggest table is set for a fixed number of rows rather than a percentage, this gets an auto analyse about every 15 minutes.
> 
> After an update this just stops, and there are no analyse entries in the log file.  None at all, for any table.

1) What is the exact pg_restore command you are using?

2) From earlier post: '...  only analyzes tables in the new db at the 
point of reload, then shuts off again.' Provide that sequence of events 
from the Postgres log.

3) Also statistics from

https://www.postgresql.org/docs/current/monitoring-stats.html#MONITORING-PG-STAT-ALL-TABLES-VIEW

for that table after the reload.

> 
> When we restart Postgres the auto analyse restarts and catches up with the backlog.
> 
> 
> Phil Horder
> Database Mechanic
> 
> Thales
> Land & Air Systems
> 
> The information contained in this e-mail is confidential. It is intended only for the stated addressee(s) and access to it by any other person is unauthorised. If you are not an addressee, you must not disclose, copy, circulate or in any other way use or rely on the information contained in this e-mail. Such unauthorised use may be unlawful. If you have received this e-mail in error, please inform the originator immediately and delete it and all copies from your system.
> 
> Thales UK Limited. A company registered in England and Wales. Registered Office: 350 Longwater Avenue, Green Park, Reading, Berks RG2 6GF. Registered Number: 868273
> 
> Please consider the environment before printing a hard copy of this e-mail.

-- 
Adrian Klaver
[email protected]

view thread (8+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected]
  Subject: Re: Restore of a reference database kills the auto analyze processing.
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox