public inbox for [email protected]
help / color / mirror / Atom feedFrom: Ron Johnson <[email protected]>
To: pgsql-generallists.postgresql.org <[email protected]>
Subject: Re: Table copy
Date: Wed, 5 Feb 2025 16:17:11 -0500
Message-ID: <CANzqJaCutOig_e9eW_9tUeKxxs7sX5rUtBthfk9hKOEb5HcTPQ@mail.gmail.com> (raw)
In-Reply-To: <CAEZv3cru5+haHbmD+Erga_QPp6x5E8-s1NLZ0MV4vihk51=15A@mail.gmail.com>
References: <CAEZv3cqo3rze3SQUqLCNq7gbnQiDusCD4R+55UW3VtuZZeJQBg@mail.gmail.com>
<[email protected]>
<CAEZv3cpop1fqe7Z8tsiAvbvzSFVqZUMwLJ7ccv0g0F8hKhD_GA@mail.gmail.com>
<[email protected]>
<CAEZv3cqCAZhh9UVV8EvwW7W53HT84TnvyCTgzXNbOp42zE7-ug@mail.gmail.com>
<[email protected]>
<CAEZv3cru5+haHbmD+Erga_QPp6x5E8-s1NLZ0MV4vihk51=15A@mail.gmail.com>
Could there have been a network hiccup? Or some sort of timeout?
If I needed to transfer 360GB of data, I'd probably do something old school
like:
1. write a PowerShell script to export a set of rows into a csv file, 7zip
compress it, then rsync or scp it to the target.
2. Write a bash script to decompress it then load the data into the PG
table.
3. Repeat (1) with the next set of data, and (2) until complete. Start the
second (1) while the first (2) is running.
That's how I migrated 12GB of Oracle data to PG (except of course bash, not
PowerShell).
On Wed, Feb 5, 2025 at 4:05 PM Andy Hartman <[email protected]> wrote:
> nothing in log from mssql side and no anti-virus
>
> On Wed, Feb 5, 2025 at 2:06 PM Adrian Klaver <[email protected]>
> wrote:
>
>>
>>
>> On 2/5/25 9:46 AM, Andy Hartman wrote:
>> > [6992] ERROR: unexpected EOF on client connection with an open
>> transaction
>> > 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03,
>> > line 24431524, column dataintegrity
>> > 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03
>> > (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity,
>> > t_stamp) FROM STDIN (FORMAT BINARY)
>> > 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection
>> > because protocol synchronization was lost
>>
>> You need to look at the other end of the connection also, in other words
>> what is happening on the MS SQL Server 2016/Windows Server 2019 side?
>>
>> Also is there anti-virus software running on either end?
>>
>>
>>
>> --
>> Adrian Klaver
>> [email protected]
>>
>
--
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!
view thread (5+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected]
Subject: Re: Table copy
In-Reply-To: <CANzqJaCutOig_e9eW_9tUeKxxs7sX5rUtBthfk9hKOEb5HcTPQ@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox