public inbox for [email protected]
help / color / mirror / Atom feedIncremental load from SQL server DB to postgressql
6+ messages / 6 participants
[nested] [flat]
* Incremental load from SQL server DB to postgressql
@ 2024-09-05 13:54 Sabyasachi Mukherjee <[email protected]>
2024-09-05 14:01 ` Re: Incremental load from SQL server DB to postgressql Holger Jakobs <[email protected]>
2024-09-05 14:11 ` Re: Incremental load from SQL server DB to postgressql Wasim Devale <[email protected]>
2024-09-06 03:44 ` Re: Incremental load from SQL server DB to postgressql Muhammad Usman Khan <[email protected]>
2024-09-08 22:01 ` RE: Incremental load from SQL server DB to postgressql [email protected]
0 siblings, 4 replies; 6+ messages in thread
From: Sabyasachi Mukherjee @ 2024-09-05 13:54 UTC (permalink / raw)
To: [email protected] <[email protected]>
Hello All,
I have to implement an incremental load from a SQL server DB to a postgresql DB. I would prefer it to be pull from postgres.
SSIS is not the preferred option. Can you please advise about the possibilities?
Sabyasachi Mukherjee
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
@ 2024-09-05 14:01 ` Holger Jakobs <[email protected]>
2024-09-05 14:56 ` Re: Incremental load from SQL server DB to postgressql Bo Victor Thomsen <[email protected]>
3 siblings, 1 reply; 6+ messages in thread
From: Holger Jakobs @ 2024-09-05 14:01 UTC (permalink / raw)
To: [email protected]
You could try to use BCP.exe for exporting from MS SQL to a flat file per table. Load into PG SQL Server with COPY or \copy (psql).
Using the TSQL foreign data wrapper to pull data over is another option. This FDW isn't very well maintained, though.
Regards
Holger
--
Holger Jakobs, Bergisch Gladbach
Tel. +49 178 9759012
Am 5. September 2024 15:54:31 MESZ schrieb Sabyasachi Mukherjee <[email protected]>:
>Hello All,
>
>I have to implement an incremental load from a SQL server DB to a postgresql DB. I would prefer it to be pull from postgres.
>SSIS is not the preferred option. Can you please advise about the possibilities?
>
>Sabyasachi Mukherjee
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
2024-09-05 14:01 ` Re: Incremental load from SQL server DB to postgressql Holger Jakobs <[email protected]>
@ 2024-09-05 14:56 ` Bo Victor Thomsen <[email protected]>
0 siblings, 0 replies; 6+ messages in thread
From: Bo Victor Thomsen @ 2024-09-05 14:56 UTC (permalink / raw)
To: [email protected]
You could use the the /*ogc_fdw*/ foreign data wrapper.
It's a data wrapper for accessing spatial data using the GDAL library.
But it works just fine with non-spatial data too, including
MS-SqlServer. And it's well maintained.
Med venlig hilsen / Best regards
Bo Victor Thomsen
On 05-09-2024 16:01, Holger Jakobs wrote:
> You could try to use BCP.exe for exporting from MS SQL to a flat file
> per table. Load into PG SQL Server with COPY or \copy (psql).
>
> Using the TSQL foreign data wrapper to pull data over is another
> option. This FDW isn't very well maintained, though.
>
> Regards
> Holger
>
> --
> Holger Jakobs, Bergisch Gladbach
> Tel. +49 178 9759012
>
>
> Am 5. September 2024 15:54:31 MESZ schrieb Sabyasachi Mukherjee
> <[email protected]>:
>
> Hello All,
>
> I have to implement an incremental load from a SQL server DB to a
> postgresql DB. I would prefer it to be pull from postgres.
> SSIS is not the preferred option. Can you please advise about the
> possibilities?
>
> Sabyasachi Mukherjee
>
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
@ 2024-09-05 14:11 ` Wasim Devale <[email protected]>
3 siblings, 0 replies; 6+ messages in thread
From: Wasim Devale @ 2024-09-05 14:11 UTC (permalink / raw)
To: Sabyasachi Mukherjee <[email protected]>; +Cc: Pgsql-admin <[email protected]>
ADF Pipeline would be great for your need.
Thanks,
Wasim
On Thu, 5 Sept, 2024, 7:24 pm Sabyasachi Mukherjee, <
[email protected]> wrote:
> Hello All,
>
> I have to implement an incremental load from a SQL server DB to a
> postgresql DB. I would prefer it to be pull from postgres.
> SSIS is not the preferred option. Can you please advise about the
> possibilities?
>
> Sabyasachi Mukherjee
>
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
@ 2024-09-06 03:44 ` Muhammad Usman Khan <[email protected]>
3 siblings, 0 replies; 6+ messages in thread
From: Muhammad Usman Khan @ 2024-09-06 03:44 UTC (permalink / raw)
To: Sabyasachi Mukherjee <[email protected]>; +Cc: [email protected] <[email protected]>
Hi,
You can use pgloader. It is a powerful tool that can migrate data from SQL
Server to PostgreSQL efficiently, and it supports incremental loads or the
other option is to use file_fdw, it allows PostgreSQL to directly query
flat files as if they were tables, without importing the data into
PostgreSQL. It can be useful if you can periodically export data from SQL
Server into flat files and then query them from PostgreSQL.
On Thu, 5 Sept 2024 at 18:54, Sabyasachi Mukherjee <
[email protected]> wrote:
> Hello All,
>
> I have to implement an incremental load from a SQL server DB to a
> postgresql DB. I would prefer it to be pull from postgres.
> SSIS is not the preferred option. Can you please advise about the
> possibilities?
>
> Sabyasachi Mukherjee
>
^ permalink raw reply [nested|flat] 6+ messages in thread
* RE: Incremental load from SQL server DB to postgressql
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
@ 2024-09-08 22:01 ` [email protected]
3 siblings, 0 replies; 6+ messages in thread
From: [email protected] @ 2024-09-08 22:01 UTC (permalink / raw)
To: 'Sabyasachi Mukherjee' <[email protected]>; [email protected]
Option use ELT tool , if PostgreSQL in Azure use Azure Data Factory
Option 2 , write SQL statements to extract data in PostgreSQL format , load
into PostgreSQL using \copy command
If AWS use Schema Conversion Tool (SCT) along with Database Migration
Services (DMS)
From: Sabyasachi Mukherjee <[email protected]>
Sent: Thursday, September 5, 2024 9:55 AM
To: [email protected]
Subject: Incremental load from SQL server DB to postgressql
Hello All,
I have to implement an incremental load from a SQL server DB to a postgresql
DB. I would prefer it to be pull from postgres.
SSIS is not the preferred option. Can you please advise about the
possibilities?
Sabyasachi Mukherjee
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2024-09-08 22:01 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]>
2024-09-05 14:01 ` Holger Jakobs <[email protected]>
2024-09-05 14:56 ` Bo Victor Thomsen <[email protected]>
2024-09-05 14:11 ` Wasim Devale <[email protected]>
2024-09-06 03:44 ` Muhammad Usman Khan <[email protected]>
2024-09-08 22:01 ` [email protected]
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox