public inbox for [email protected]  

help / color / mirror / Atom feed

From: Adrian Klaver <[email protected]>
To: jack <[email protected]>
To: [email protected] <[email protected]>
Subject: Re: constant crashing
Date: Sun, 14 Apr 2024 13:28:31 -0700
Message-ID: <[email protected]> (raw)
In-Reply-To: <RFS5d0T3zgpLa3Rd39K96mcUndlPZD7ktJmzEXkPTrcIwO3U0MDFC0StbozM0qW9tl7X1YDVVYGFQhCOMFi9r4kp3OohQCFIh198LV1HZvQ=@a7q.com>
References: <RFS5d0T3zgpLa3Rd39K96mcUndlPZD7ktJmzEXkPTrcIwO3U0MDFC0StbozM0qW9tl7X1YDVVYGFQhCOMFi9r4kp3OohQCFIh198LV1HZvQ=@a7q.com>

On 4/14/24 13:18, jack wrote:
> The CSV files are being produced by another system, a WIndows app on a 
> Windows machine. I then copy them to a USB key and copy them onto the 
> ubuntu machine. The data is then imported via the COPY command.

The app?

The locale in use on the Windows machine?

The locale in use in the database?

> 
> COPY master (field01,field02..fieldX) FROM '/data/file.text' DELIMITER E'\t'
> The fields are tab delimited.
> 
> But importing the data works. I can get all the data into a single table 
> without any problems. The issue is only when I start to update the 
> single table. And that is why I started using smaller temporary tables 
> for each CSV file, to do the updates in the smaller tables before I move 
> them all to a single large table.

The import is just dumping the data in, my suspicion is the problem is 
related to using string functions on the data.

> 
> After all the data is loaded and updated, I run php programs on the 
> large table to generate reports. All of which works well EXCEPT for 
> performing the updates on the data. And I do not want to use perl or any 
> outside tool. I want it all one in SQL because I am required to document 
> all my steps so that someone else can take over, so everything needs to 
> be as simple as possible.
> 

-- 
Adrian Klaver
[email protected]

view thread (2+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected]
  Subject: Re: constant crashing
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox