public inbox for [email protected]
help / color / mirror / Atom feedRe: Table copy
5+ messages / 3 participants
[nested] [flat]
* Re: Table copy
@ 2025-02-05 19:06 Adrian Klaver <[email protected]>
2025-02-05 21:05 ` Re: Table copy Andy Hartman <[email protected]>
0 siblings, 1 reply; 5+ messages in thread
From: Adrian Klaver @ 2025-02-05 19:06 UTC (permalink / raw)
To: Andy Hartman <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]>
On 2/5/25 9:46 AM, Andy Hartman wrote:
> [6992] ERROR: unexpected EOF on client connection with an open transaction
> 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03,
> line 24431524, column dataintegrity
> 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03
> (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity,
> t_stamp) FROM STDIN (FORMAT BINARY)
> 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection
> because protocol synchronization was lost
You need to look at the other end of the connection also, in other words
what is happening on the MS SQL Server 2016/Windows Server 2019 side?
Also is there anti-virus software running on either end?
--
Adrian Klaver
[email protected]
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy
2025-02-05 19:06 Re: Table copy Adrian Klaver <[email protected]>
@ 2025-02-05 21:05 ` Andy Hartman <[email protected]>
2025-02-05 21:09 ` Re: Table copy Andy Hartman <[email protected]>
2025-02-05 21:17 ` Re: Table copy Ron Johnson <[email protected]>
2025-02-05 21:21 ` Re: Table copy Adrian Klaver <[email protected]>
0 siblings, 3 replies; 5+ messages in thread
From: Andy Hartman @ 2025-02-05 21:05 UTC (permalink / raw)
To: Adrian Klaver <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]>
nothing in log from mssql side and no anti-virus
On Wed, Feb 5, 2025 at 2:06 PM Adrian Klaver <[email protected]>
wrote:
>
>
> On 2/5/25 9:46 AM, Andy Hartman wrote:
> > [6992] ERROR: unexpected EOF on client connection with an open
> transaction
> > 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03,
> > line 24431524, column dataintegrity
> > 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03
> > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity,
> > t_stamp) FROM STDIN (FORMAT BINARY)
> > 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection
> > because protocol synchronization was lost
>
> You need to look at the other end of the connection also, in other words
> what is happening on the MS SQL Server 2016/Windows Server 2019 side?
>
> Also is there anti-virus software running on either end?
>
>
>
> --
> Adrian Klaver
> [email protected]
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy
2025-02-05 19:06 Re: Table copy Adrian Klaver <[email protected]>
2025-02-05 21:05 ` Re: Table copy Andy Hartman <[email protected]>
@ 2025-02-05 21:09 ` Andy Hartman <[email protected]>
2 siblings, 0 replies; 5+ messages in thread
From: Andy Hartman @ 2025-02-05 21:09 UTC (permalink / raw)
To: Adrian Klaver <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]>
I also reduced batch size to 5000 on the last run .. I like using this
SImplySql because it's a script I can launch, so that's why I chose that
solution... I'm using it to load a History Env.
THanks again.
On Wed, Feb 5, 2025 at 4:05 PM Andy Hartman <[email protected]> wrote:
> nothing in log from mssql side and no anti-virus
>
> On Wed, Feb 5, 2025 at 2:06 PM Adrian Klaver <[email protected]>
> wrote:
>
>>
>>
>> On 2/5/25 9:46 AM, Andy Hartman wrote:
>> > [6992] ERROR: unexpected EOF on client connection with an open
>> transaction
>> > 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03,
>> > line 24431524, column dataintegrity
>> > 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03
>> > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity,
>> > t_stamp) FROM STDIN (FORMAT BINARY)
>> > 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection
>> > because protocol synchronization was lost
>>
>> You need to look at the other end of the connection also, in other words
>> what is happening on the MS SQL Server 2016/Windows Server 2019 side?
>>
>> Also is there anti-virus software running on either end?
>>
>>
>>
>> --
>> Adrian Klaver
>> [email protected]
>>
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy
2025-02-05 19:06 Re: Table copy Adrian Klaver <[email protected]>
2025-02-05 21:05 ` Re: Table copy Andy Hartman <[email protected]>
@ 2025-02-05 21:17 ` Ron Johnson <[email protected]>
2 siblings, 0 replies; 5+ messages in thread
From: Ron Johnson @ 2025-02-05 21:17 UTC (permalink / raw)
To: pgsql-generallists.postgresql.org <[email protected]>
Could there have been a network hiccup? Or some sort of timeout?
If I needed to transfer 360GB of data, I'd probably do something old school
like:
1. write a PowerShell script to export a set of rows into a csv file, 7zip
compress it, then rsync or scp it to the target.
2. Write a bash script to decompress it then load the data into the PG
table.
3. Repeat (1) with the next set of data, and (2) until complete. Start the
second (1) while the first (2) is running.
That's how I migrated 12GB of Oracle data to PG (except of course bash, not
PowerShell).
On Wed, Feb 5, 2025 at 4:05 PM Andy Hartman <[email protected]> wrote:
> nothing in log from mssql side and no anti-virus
>
> On Wed, Feb 5, 2025 at 2:06 PM Adrian Klaver <[email protected]>
> wrote:
>
>>
>>
>> On 2/5/25 9:46 AM, Andy Hartman wrote:
>> > [6992] ERROR: unexpected EOF on client connection with an open
>> transaction
>> > 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03,
>> > line 24431524, column dataintegrity
>> > 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03
>> > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity,
>> > t_stamp) FROM STDIN (FORMAT BINARY)
>> > 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection
>> > because protocol synchronization was lost
>>
>> You need to look at the other end of the connection also, in other words
>> what is happening on the MS SQL Server 2016/Windows Server 2019 side?
>>
>> Also is there anti-virus software running on either end?
>>
>>
>>
>> --
>> Adrian Klaver
>> [email protected]
>>
>
--
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Table copy
2025-02-05 19:06 Re: Table copy Adrian Klaver <[email protected]>
2025-02-05 21:05 ` Re: Table copy Andy Hartman <[email protected]>
@ 2025-02-05 21:21 ` Adrian Klaver <[email protected]>
2 siblings, 0 replies; 5+ messages in thread
From: Adrian Klaver @ 2025-02-05 21:21 UTC (permalink / raw)
To: Andy Hartman <[email protected]>; +Cc: pgsql-generallists.postgresql.org <[email protected]>
On 2/5/25 13:05, Andy Hartman wrote:
> nothing in log from mssql side and no anti-virus
How about the Windows Server 2019 system log?
--
Adrian Klaver
[email protected]
^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2025-02-05 21:21 UTC | newest]
Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2025-02-05 19:06 Re: Table copy Adrian Klaver <[email protected]>
2025-02-05 21:05 ` Andy Hartman <[email protected]>
2025-02-05 21:09 ` Andy Hartman <[email protected]>
2025-02-05 21:17 ` Ron Johnson <[email protected]>
2025-02-05 21:21 ` Adrian Klaver <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox