Feedback-ID: i76984098:Fastmail
Message-ID: <61c32ecb-8d5e-4c90-8387-6de712562222@aklaver.com>
Date: Sun, 2 Mar 2025 21:33:07 -0800
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: Please implement a catch-all error handler per row, for COPY
To: me nefcanto <sn.1361@gmail.com>, Greg Sabino Mullane <htamfids@gmail.com>
Cc: "David G. Johnston" <david.g.johnston@gmail.com>,
 Tom Lane <tgl@sss.pgh.pa.us>, pgsql-general@lists.postgresql.org
References: <CAEHBEOCqqkSitU5gx=8aHD3ZeLtRy-1eC=Xs=xB-thFNR9JpYA@mail.gmail.com>
 <2961422.1740846012@sss.pgh.pa.us>
 <CAKFQuwbRCWP2DMHyW1LABuWAjDFVGE4mPJNfXOeTqzMpeBQ_Hw@mail.gmail.com>
 <CAKAnmm+OvPKF5p1vZ1FNs1AidJvBriT_+XBz8UZBpsNy7qiHWQ@mail.gmail.com>
 <CAEHBEOBAYsELbjC7KvifHk00jNVJvCRpZkHDML9ebsP48g4w+A@mail.gmail.com>
Content-Language: en-US
From: Adrian Klaver <adrian.klaver@aklaver.com>
In-Reply-To: <CAEHBEOBAYsELbjC7KvifHk00jNVJvCRpZkHDML9ebsP48g4w+A@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Archived-At: <https://www.postgresql.org/message-id/61c32ecb-8d5e-4c90-8387-6de712562222%40aklaver.com>
Precedence: bulk

On 3/2/25 19:44, me nefcanto wrote:
> Thank you all for responding. With respect, I don't understand why COPY 
> gets related to ETL. All of the requirements I mentioned above have 
> nothing to do with ETL. We have a table of categories. A hierarchical 
> table. This is a multitenant app. Hundreds of thousands of records are 
> in it. We want to calculate the hierarchical properties (nested set 
> models, node depth, determining leaves, materialized paths, etc.) and 
> then update the entire table. What does this have to do with ETL? Or as

Pretty sure it defines ETL, extract data from a source, transform it to 
meet the properties and load it.

At any rate:

1) ON_ERROR IGNORE only just appeared in Postgres 17.

2) Any further changes to it would constitute a feature change that can 
only happen in major version upgrade. The next major version is due this 
Fall and development is already well under way. The chances of it making 
it in given the time frame is slim, so that pushes a practicable 
deadline until Fall of 2026.

3) As I mentioned in a previous post there are packages already out 
there that may get you want you want now.


-- 
Adrian Klaver
adrian.klaver@aklaver.com