Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tfjUB-004gex-5f for pgsql-general@arkaria.postgresql.org; Wed, 05 Feb 2025 17:46:51 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tfjUA-00Gaox-9I for pgsql-general@arkaria.postgresql.org; Wed, 05 Feb 2025 17:46:50 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tfjU9-00Gaop-Uy for pgsql-general@lists.postgresql.org; Wed, 05 Feb 2025 17:46:49 +0000 Received: from mail-yb1-xb2f.google.com ([2607:f8b0:4864:20::b2f]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1tfjU7-003YEW-1S for pgsql-general@lists.postgresql.org; Wed, 05 Feb 2025 17:46:49 +0000 Received: by mail-yb1-xb2f.google.com with SMTP id 3f1490d57ef6-e5b296611d1so738080276.1 for ; Wed, 05 Feb 2025 09:46:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1738777606; x=1739382406; darn=lists.postgresql.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ZijvnF5qg4iw5ZeG8i5i0YNE34sNnPXlgiPIueAJKLQ=; b=EgPdwe6bpewqi7D2F8W8KzNOzO5UNfb814iAgb4VA3PzX7qKHHo7Q7ezhyYGRfbqhe OydaYneC+a2w6TivcivaMc82lixFWUff42/KWfIJiWp3N47SPwwdWW6fNBtwMy7dLKwm I/d98SOG0AzLCNBLPE6LJ7ov77OWgHy8YXw942fk6AGEPFwsjFkKB4s7JXPaetbcHrTF gVcPolHAno0yi0/xu6HnYYm4qzbCU4fPn70rw8CTXNIHD9uZXsw2sJ6oZ2DEVLPF/7Jf Hs1bcMpufSricsinXklSmGiRXJ0hgy4BIBjbFRlc/+mF5s4F5J+R0qQB78vn7MifoluA h/YQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738777606; x=1739382406; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ZijvnF5qg4iw5ZeG8i5i0YNE34sNnPXlgiPIueAJKLQ=; b=ER3zvrFpl2lIONL9rydmH6B2bBd8SUroBcgwMSO139anKzx9TIJLexCe6lGyHVHhb9 qmh546/u8G+z0SybYP6WGkqMp/KUt1YwXvZggFwCJQUrzuTXctU4LCvmX5rEI1Pko0EO iwyCFnocz0vJbCV/ti9wCuZl4dY37WwpisBpTMdRRH67KF6iunZQSqbtuWBOTyKXzBqT 7ypehWBPsa+iFQu+RT9xwR0SRtRSnXLIT77lLbGf3DBTTLAcLy1J5MqJsNC7+T++aRTW Iglz3YCkeXNadkxCgDt6VbPSGwQ2zrWwDbNaXeBIRRDEtq2H53RbI9z2ffcSpP2RWU6F BWgg== X-Gm-Message-State: AOJu0YyKC7dnY+nFRQEvM5PjTnjP5zQqM9swdbldgyVCnZx2/mNZ4fvR BCxkJNjrVWBFPFqTraZCyqJzWLMvi27E2qwr2Ljcz8Sq5Za/DlSUnC5I71bvO2OCHNxzEMYpFmo DuZaQpyNj+4RX6NrOOABxWT1sOGFDPGHZ X-Gm-Gg: ASbGncu7c/zQvCI1oeKd/sYzS1yDUyZjQFM+A5k/9U0Iub7rE3vW1rmMa3r40dy4Kd8 NCHAFrFk9TD8hn69Qkh3aHvBnR7Riho8NjITk9khJ7fBJs9pG/3CQPBgoVLE8qoFjFepqrgY= X-Google-Smtp-Source: AGHT+IE7KBXvlGifxHQeKrKvyFMAUCO1thdu2JE9B6e+38kTss5zDOlOvfrD7WkX1Ff/iDXYFw2tr76met/u4aq2U0c= X-Received: by 2002:a05:690c:46c2:b0:6f9:4c88:6fae with SMTP id 00721157ae682-6f99a64b12amr2215937b3.12.1738777606274; Wed, 05 Feb 2025 09:46:46 -0800 (PST) MIME-Version: 1.0 References: <0057c073-6dcb-4425-92fc-3a766a78ee96@aklaver.com> In-Reply-To: <0057c073-6dcb-4425-92fc-3a766a78ee96@aklaver.com> From: Andy Hartman Date: Wed, 5 Feb 2025 12:46:35 -0500 X-Gm-Features: AWEUYZmg-ShAbzwutUeWcO8N4orVALHKGX4EAW7Rc-gCSBT8YzK_JTG_tGAC7BM Message-ID: Subject: Re: Table copy To: Adrian Klaver Cc: "pgsql-generallists.postgresql.org" Content-Type: multipart/alternative; boundary="00000000000090c9cf062d68b587" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --00000000000090c9cf062d68b587 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable [6992] ERROR: unexpected EOF on client connection with an open transaction 2025-02-05 12:19:44.919 EST [6992] CONTEXT: COPY sqlt_data_1_2022_03, line 24431524, column dataintegrity 2025-02-05 12:19:44.919 EST [6992] STATEMENT: COPY sqlt_data_1_2022_03 (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, t_stamp) FROM STDIN (FORMAT BINARY) 2025-02-05 12:19:44.919 EST [6992] FATAL: terminating connection because protocol synchronization was lost On Wed, Feb 5, 2025 at 11:15=E2=80=AFAM Adrian Klaver wrote: > On 2/5/25 05:40, Andy Hartman wrote: > > mssql - 2016 > > PG - 16.1 > > latest release for Simplysql > Latest is a relative term and requires anyone in the future coming > across this thread to work out what you are talking about. For that > person the current version is 2.1.0. > > > Invoke-SqlBulkCopy -SourceConnectionName "src" -SourceTable > > "sqlt_data_1_2022_03" -DestinationConnectionName "dst" -DestinationTabl= e > > "sqlt_data_1_2022_03" -BatchSize 10000 -Notify > > > > 2.4 billion records -- I have down other tables of same size no proble= ms > > Same version of SimplySql? > > Same source and destination databases? > > Did you look at the Postgres and system logs to see if there was > relevant information? > > > > > > mssql OS Windows Server 2019 > > PG OS Windows Server 2022 > > > > Table: > > image.png > > > > > > -- > Adrian Klaver > adrian.klaver@aklaver.com > > --00000000000090c9cf062d68b587 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
[6992] ERROR:=C2=A0 unexpected EOF o= n client connection with an open transaction
2025-02-05 12:19:44.= 919 EST [6992] CONTEXT:=C2=A0 COPY sqlt_data_1_2022_03, line 24431524, colu= mn dataintegrity
2025-02-05 12:19:44.919 EST [6992] STATEMENT:=C2= =A0 COPY sqlt_data_1_2022_03 (tagid, intvalue, floatvalue, stringvalue, dat= evalue, dataintegrity, t_stamp) FROM STDIN (FORMAT BINARY)
2025-0= 2-05 12:19:44.919 EST [6992] FATAL:=C2=A0 terminating connection because pr= otocol synchronization was lost

On Wed, Fe= b 5, 2025 at 11:15=E2=80=AFAM Adrian Klaver <adrian.klaver@aklaver.com> wrote:
On 2/5/25 05:40, Andy Hartman wr= ote:
> mssql - 2016
> PG - 16.1
> latest release=C2=A0for Simplysql
Latest is a relative term and requires anyone in the future coming
across this thread to work out what you are talking about. For that
person the current version is 2.1.0.

> Invoke-SqlBulkCopy -SourceConnectionName "src" -SourceTable =
> "sqlt_data_1_2022_03" -DestinationConnectionName "dst&q= uot; -DestinationTable
> "sqlt_data_1_2022_03" -BatchSize 10000 -Notify
>
> 2.4 billion records=C2=A0 -- I have down=C2=A0other tables of same siz= e no problems

Same version of SimplySql?

Same source and destination databases?

Did you look at the Postgres and system logs to see if there was
relevant information?


>
> mssql OS Windows Server 2019
> PG OS Windows Server 2022
>
> Table:
> image.png
>
>

--
Adrian Klaver
adrian.klave= r@aklaver.com

--00000000000090c9cf062d68b587--