public inbox for [email protected]  

help / color / mirror / Atom feed

From: Adrian Klaver <[email protected]>
To: jack <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: constant crashing
Date: Sun, 14 Apr 2024 10:05:21 -0700
Message-ID: <[email protected]> (raw)
In-Reply-To: <HgsD3gOH-K3PK0n7PogBu3X1goIJ3_kN04shv7womj--6jQcAggYWdAOqYOmq1VVlVPf6TiHvxpZCvwmFawmHMEjciHsLErgsjaLruEspg0=@a7q.com>
References: <HgsD3gOH-K3PK0n7PogBu3X1goIJ3_kN04shv7womj--6jQcAggYWdAOqYOmq1VVlVPf6TiHvxpZCvwmFawmHMEjciHsLErgsjaLruEspg0=@a7q.com>

On 4/14/24 09:20, jack wrote:
> The full error reads:
> server closed the connection expectantly
> This probably means the server terminated abnormally
> before or while processing the request.
> error: connection to server was lost

Look at the OS system log.

> 
> PostgreSQL 16.2
> 
> I also believe it is a resource issue which can be rectified with a 
> setting, but which setting?
> If you were updating 100 million records what settings would you adjust?
> 
> Here are the updates I am performing on the 100 million records:
> UPDATE table SET category_modified = UPPER(category);
> UPDATE table SET category_modified = 
> REGEXP_REPLACE(REPLACE(REPLACE(category_modified, '''','-'), '`', '-'), 
> '\s{2,}', ' ', 'g') WHERE  AND LENGTH(category_modified)>1 AND 
> POSITION('--' IN category_modified)>0;
> UPDATE table SET category_modified = REPLACE(category_modified,' ','-');
> UPDATE table SET category_modified = CASE WHEN category_modified IS NOT 
> NULL THEN regexp_replace(category_modified, '[^a-zA-Z]$', '') ELSE NULL END;
> UPDATE table SET category_modified = regexp_replace(category_modified, 
> '-{2,}', '-', 'g');
> UPDATE table SET category_modified = SUBSTRING(category_modified FROM 1 
> FOR LENGTH(category_modified) - 1) WHERE LENGTH(category_modified)>1 AND 
> category_modified LIKE '%-';

Is the above all being done in one script/transaction?

Again what are the table definitions for the tables being copied into 
and/or modified?

> 
> 
> 
> 

-- 
Adrian Klaver
[email protected]

view thread (2+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected]
  Subject: Re: constant crashing
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox