Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lqyGz-0007Dr-OL for pgsql-odbc@arkaria.postgresql.org; Wed, 09 Jun 2021 13:29:33 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1lqyGy-0004DL-M9 for pgsql-odbc@arkaria.postgresql.org; Wed, 09 Jun 2021 13:29:32 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lqxdy-0001f3-Og for pgsql-odbc@lists.postgresql.org; Wed, 09 Jun 2021 12:49:14 +0000 Received: from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1lqxdw-0007m5-OD for pgsql-odbc@lists.postgresql.org; Wed, 09 Jun 2021 12:49:14 +0000 Received: by mail-wm1-x32a.google.com with SMTP id b145-20020a1c80970000b029019c8c824054so4193088wmd.5 for ; Wed, 09 Jun 2021 05:49:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=kJ3Z6907Wzo+8wjPrhrb1LgnZtFxRq78saEhbCvCMSE=; b=jIbhlUe4lZVdDkBi+XmJUelBLOVqiwXRdNtlZF884QKxaKE5qtLJmygO8rA6jLGm3X bldpXxaaEU5ezjwgLclAdULRgrrOPSSa35A9TZDOB+FroM2mlqtXIQPQf3QkToW+NrYS UJjPKMJK4dUaVrNpDDfof3wHI3sJKNDiZLqO3qoauO5sOO7qHcnKQsUziud+MEc6kbRs u3jhgcISjnu4/z6F7QOygykjX9S2WFWerEndQ8smMA0sd6lThnwvdACcy6tCTUgjBIs3 DSaJ0/lakM0hOwbaSVXt9uquLZjNHsMSz660PBNF3tJyQqpAMDAqs1KSL1RyYEfjGKcq DBbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=kJ3Z6907Wzo+8wjPrhrb1LgnZtFxRq78saEhbCvCMSE=; b=ZpFTRgVRva+tMV1tAJUedSg8L7Mpk4Fz7KX/wzvYD62CrCBSfKpT/6piy42nkPkfp/ jza/FmAhSWqTddC5kgyiCJ4TdZiZCQaRw02aq7WgT46bqNTPLlrHBhkhkuy8M3AtRCn7 eXpBcAJbWsOH4k/RHo+scUIdX9cPuIAg3MG8xPSLYwHko37q/iKwAxDLP+WTVQKg6yCM 42qNGJ4+aVUkE2a2KifKxxisOQOnzuPqfBbSnfeqZedZkjPjQ1brQ75uFX4bYBIurHFf Iz+0amZRf2hKGlVaqmqvm9pmgwoVwQZQz4oYnIBfNN3UuaUiQXQWeMcsEArS5QACrzuZ VlmQ== X-Gm-Message-State: AOAM5335B5wIxMCyUIwF9FD+8meF8z+HDa27Cy0r3fu567iRfRMM/C6w coEcZGxKqtgTwEGE0TWqrYrmGGVg3hYxkJkNjFwQ91MS X-Google-Smtp-Source: ABdhPJw/8Oui3uZC/wfOdea5Q2M9a7LJOeTBDU0/eTTJvW7xsVMnlhXH+xuO8PV6NtHD5EjGSNqic7X6lINxON6JfTI= X-Received: by 2002:a05:600c:4fc5:: with SMTP id o5mr9316612wmq.148.1623242951530; Wed, 09 Jun 2021 05:49:11 -0700 (PDT) MIME-Version: 1.0 From: Paul van Rixel Date: Wed, 9 Jun 2021 14:48:58 +0200 Message-ID: Subject: Data transfer from PG to SQL Server To: pgsql-odbc@lists.postgresql.org Content-Type: multipart/alternative; boundary="000000000000829b0305c454b335" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000829b0305c454b335 Content-Type: text/plain; charset="UTF-8" Hi all, I'm looking for the best way to transfer data on a weekly basis to a SQL Server Instance which will be the staging area for BI reporting. A SQL Server Linked Server configuration is because of security issues not allowed so now I need some help! What I did previously was installing the Postgres ODBC Driver 12_02 version, configuration is ok because a test is successful. So next step was to configure a linked server and in that way I can see the tables. To get the data from straigtforwarded tables without JSON or XML columns I used openquery from SQL Server. That works for 80% of the tables. I also see in the Postgresql logfiles that I'm connected and read that table. Large tables (> 3GB) however did not transfer! Also tried with Export/Import wizard from SQL Server Managememnt Studio but also from SSIS. Both failed. So my simple question is how to transfer Postgresql data/tables to SQL Server without Linked Server or other paid tools like pgOledb? I could not find answer so that's why I'm here! Any help would be appreciated! Best regards, Paul van Rixel DBA --000000000000829b0305c454b335 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi all,

I'm looking for the best wa= y to transfer data on a weekly basis to a SQL Server Instance which will be= the staging area for BI reporting. A SQL Server Linked Server configuratio= n is because of security issues not allowed so now I need some help!
<= div>
What I did previously was installing the=C2=A0 Postgres = ODBC Driver 12_02 version, configuration is ok because a test is successful= .=C2=A0 So next step was to configure a linked server and in that way I can= see the tables. To get the data from straigtforwarded tables without JSON = or XML columns I used openquery from SQL Server. That works for 80% of the = tables. I also see in the Postgresql logfiles that I'm connected and re= ad that table.
Large tables (> 3GB) however did not transfer!<= br>
Also tried with Export/Import wizard from SQL Server Manageme= mnt Studio but also from SSIS. Both failed.

So my = simple question is how to transfer Postgresql data/tables to SQL Server wit= hout Linked Server or other paid tools like pgOledb? I could not find answe= r so that's why I'm here!

Any help would b= e appreciated!

Best regards,

<= div>Paul van Rixel
DBA
--000000000000829b0305c454b335--