public inbox for [email protected]
help / color / mirror / Atom feedFrom: Adrian Klaver <[email protected]>
To: jack <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: constant crashing
Date: Sun, 14 Apr 2024 07:58:18 -0700
Message-ID: <[email protected]> (raw)
In-Reply-To: <EOK1DtQPZjUx8lfmH2mKBjPejveLIfJ8M_GR-At5A9yhT-Ki5JE9GyvQ657CQZWOmZu3OsByefHlGymD3i60c-eYE7uiSYQDVZsujA3fZZA=@a7q.com>
References: <EOK1DtQPZjUx8lfmH2mKBjPejveLIfJ8M_GR-At5A9yhT-Ki5JE9GyvQ657CQZWOmZu3OsByefHlGymD3i60c-eYE7uiSYQDVZsujA3fZZA=@a7q.com>
On 4/14/24 07:24, jack wrote:
> Hello,
> I am trying to load about 1.4 billion records into a postgresql table.
> The data is in about 100 individual CSV files which I load individually
> into the table using the COPY command.
> After the data is loaded I perform updates to the data, and this is when
> I get errors. Some updates work, some crash.
> I am using psql and an SQL script file (update.sql) to perform the
> updating (UPDATE table SET field=UPPER(field), etc.).
>
> The errors are all "Server closed the connection unexpectedly"
>
> I have been working on this for just over 1 year now, documenting every
> step, and I am still unable to get this to work without it crashing
> somewhere along the way.
> I am beginning to wonder if postgreSQL is bi-polar.
More information needed, to start:
1) Complete example of the code in the script.
2) Table definition(s) of those being copied into.
3) Sample of the data being copied.
4) The error message(s) generated.
5) Database locale
>
> Any help would be greatly appreciated.
> Thank you
--
Adrian Klaver
[email protected]
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected]
Subject: Re: constant crashing
In-Reply-To: <[email protected]>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox