public inbox for [email protected]help / color / mirror / Atom feed
Table copy 5+ messages / 2 participants [nested] [flat]
* Table copy @ 2025-02-04 19:51 Andy Hartman <[email protected]> 2025-02-04 20:02 ` Re: Table copy Adrian Klaver <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Andy Hartman @ 2025-02-04 19:51 UTC (permalink / raw) To: pgsql-generallists.postgresql.org <[email protected]> I'm copying a large table from mssql to PG using SImplysql and in the Log I see this message 2025-02-04 14:42:17.975 EST [4796] ERROR: unexpected EOF on client connection with an open transaction 2025-02-04 14:42:17.975 EST [4796] CONTEXT: COPY sqlt_data_1_2022_03, line 208274199, column tagid 2025-02-04 14:42:17.975 EST [4796] STATEMENT: COPY sqlt_data_1_2022_03 (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, t_stamp) FROM STDIN (FORMAT BINARY) 2025-02-04 14:42:18.158 EST [4796] FATAL: terminating connection because protocol synchronization was lost 2025-02-04 14:42:18.265 EST [4796] LOG: could not send data to client: An established connection was aborted by the software in your host machine. it then dies with a data stream error.I have copied other tables on this size with no problems. THanks. ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy 2025-02-04 19:51 Table copy Andy Hartman <[email protected]> @ 2025-02-04 20:02 ` Adrian Klaver <[email protected]> 2025-02-05 13:40 ` Re: Table copy Andy Hartman <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Adrian Klaver @ 2025-02-04 20:02 UTC (permalink / raw) To: Andy Hartman <[email protected]>; pgsql-generallists.postgresql.org <[email protected]> On 2/4/25 11:51 AM, Andy Hartman wrote: > I'm copying a large table from mssql to PG using SImplysql and in the > Log I see this message > > 2025-02-04 14:42:17.975 EST [4796] ERROR: unexpected EOF on client > connection with an open transaction The above pretty much spells it out. Something messed with the connection from the client. You need to look at Postgres and system logs to see if you can track down what? FYI, more information would be helpful: 1) MS SQL version. 2) Postgres version. 3) SimplySQL version. 4) The complete copy command. 5) The amount of data being transferred. 6) The OS'es and their versions on both ends. > 2025-02-04 14:42:17.975 EST [4796] CONTEXT: COPY sqlt_data_1_2022_03, > line 208274199, column tagid > 2025-02-04 14:42:17.975 EST [4796] STATEMENT: COPY sqlt_data_1_2022_03 > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, > t_stamp) FROM STDIN (FORMAT BINARY) > 2025-02-04 14:42:18.158 EST [4796] FATAL: terminating connection > because protocol synchronization was lost > 2025-02-04 14:42:18.265 EST [4796] LOG: could not send data to client: > An established connection was aborted by the software in your host machine. > it then dies with a data stream error.I have copied other tables on this > size with no problems. > > THanks. > > -- Adrian Klaver [email protected] ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy 2025-02-04 19:51 Table copy Andy Hartman <[email protected]> 2025-02-04 20:02 ` Re: Table copy Adrian Klaver <[email protected]> @ 2025-02-05 13:40 ` Andy Hartman <[email protected]> 2025-02-05 16:15 ` Re: Table copy Adrian Klaver <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Andy Hartman @ 2025-02-05 13:40 UTC (permalink / raw) To: Adrian Klaver <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]> mssql - 2016 PG - 16.1 latest release for Simplysql Invoke-SqlBulkCopy -SourceConnectionName "src" -SourceTable "sqlt_data_1_2022_03" -DestinationConnectionName "dst" -DestinationTable "sqlt_data_1_2022_03" -BatchSize 10000 -Notify 2.4 billion records -- I have down other tables of same size no problems mssql OS Windows Server 2019 PG OS Windows Server 2022 Table: [image: image.png] On Tue, Feb 4, 2025 at 3:02 PM Adrian Klaver <[email protected]> wrote: > > > On 2/4/25 11:51 AM, Andy Hartman wrote: > > I'm copying a large table from mssql to PG using SImplysql and in the > > Log I see this message > > > > 2025-02-04 14:42:17.975 EST [4796] ERROR: unexpected EOF on client > > connection with an open transaction > > The above pretty much spells it out. > > Something messed with the connection from the client. > > You need to look at Postgres and system logs to see if you can track > down what? > > FYI, more information would be helpful: > > 1) MS SQL version. > > 2) Postgres version. > > 3) SimplySQL version. > > 4) The complete copy command. > > 5) The amount of data being transferred. > > 6) The OS'es and their versions on both ends. > > > > 2025-02-04 14:42:17.975 EST [4796] CONTEXT: COPY sqlt_data_1_2022_03, > > line 208274199, column tagid > > 2025-02-04 14:42:17.975 EST [4796] STATEMENT: COPY sqlt_data_1_2022_03 > > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, > > t_stamp) FROM STDIN (FORMAT BINARY) > > 2025-02-04 14:42:18.158 EST [4796] FATAL: terminating connection > > because protocol synchronization was lost > > 2025-02-04 14:42:18.265 EST [4796] LOG: could not send data to client: > > An established connection was aborted by the software in your host > machine. > > it then dies with a data stream error.I have copied other tables on this > > size with no problems. > > > > THanks. > > > > > > -- > Adrian Klaver > [email protected] > Attachments: [image/png] image.png (6.4K, 3-image.png) download | view image ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy 2025-02-04 19:51 Table copy Andy Hartman <[email protected]> 2025-02-04 20:02 ` Re: Table copy Adrian Klaver <[email protected]> 2025-02-05 13:40 ` Re: Table copy Andy Hartman <[email protected]> @ 2025-02-05 16:15 ` Adrian Klaver <[email protected]> 2025-02-05 17:46 ` Re: Table copy Andy Hartman <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Adrian Klaver @ 2025-02-05 16:15 UTC (permalink / raw) To: Andy Hartman <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]> On 2/5/25 05:40, Andy Hartman wrote: > mssql - 2016 > PG - 16.1 > latest release for Simplysql Latest is a relative term and requires anyone in the future coming across this thread to work out what you are talking about. For that person the current version is 2.1.0. > Invoke-SqlBulkCopy -SourceConnectionName "src" -SourceTable > "sqlt_data_1_2022_03" -DestinationConnectionName "dst" -DestinationTable > "sqlt_data_1_2022_03" -BatchSize 10000 -Notify > > 2.4 billion records -- I have down other tables of same size no problems Same version of SimplySql? Same source and destination databases? Did you look at the Postgres and system logs to see if there was relevant information? > > mssql OS Windows Server 2019 > PG OS Windows Server 2022 > > Table: > image.png > > -- Adrian Klaver [email protected] ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy 2025-02-04 19:51 Table copy Andy Hartman <[email protected]> 2025-02-04 20:02 ` Re: Table copy Adrian Klaver <[email protected]> 2025-02-05 13:40 ` Re: Table copy Andy Hartman <[email protected]> 2025-02-05 16:15 ` Re: Table copy Adrian Klaver <[email protected]> @ 2025-02-05 17:46 ` Andy Hartman <[email protected]> 0 siblings, 0 replies; 5+ messages in thread From: Andy Hartman @ 2025-02-05 17:46 UTC (permalink / raw) To: Adrian Klaver <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]> [6992] ERROR: unexpected EOF on client connection with an open transaction 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03, line 24431524, column dataintegrity 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03 (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, t_stamp) FROM STDIN (FORMAT BINARY) 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection because protocol synchronization was lost On Wed, Feb 5, 2025 at 11:15 AM Adrian Klaver <[email protected]> wrote: > On 2/5/25 05:40, Andy Hartman wrote: > > mssql - 2016 > > PG - 16.1 > > latest release for Simplysql > Latest is a relative term and requires anyone in the future coming > across this thread to work out what you are talking about. For that > person the current version is 2.1.0. > > > Invoke-SqlBulkCopy -SourceConnectionName "src" -SourceTable > > "sqlt_data_1_2022_03" -DestinationConnectionName "dst" -DestinationTable > > "sqlt_data_1_2022_03" -BatchSize 10000 -Notify > > > > 2.4 billion records -- I have down other tables of same size no problems > > Same version of SimplySql? > > Same source and destination databases? > > Did you look at the Postgres and system logs to see if there was > relevant information? > > > > > > mssql OS Windows Server 2019 > > PG OS Windows Server 2022 > > > > Table: > > image.png > > > > > > -- > Adrian Klaver > [email protected] > > ^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2025-02-05 17:46 UTC | newest] Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2025-02-04 19:51 Table copy Andy Hartman <[email protected]> 2025-02-04 20:02 ` Adrian Klaver <[email protected]> 2025-02-05 13:40 ` Andy Hartman <[email protected]> 2025-02-05 16:15 ` Adrian Klaver <[email protected]> 2025-02-05 17:46 ` Andy Hartman <[email protected]>
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox