public inbox for [email protected]help / color / mirror / Atom feed
Incremental load from SQL server DB to postgressql 6+ messages / 6 participants [nested] [flat]
* Incremental load from SQL server DB to postgressql @ 2024-09-05 13:54 Sabyasachi Mukherjee <[email protected]> 0 siblings, 4 replies; 6+ messages in thread From: Sabyasachi Mukherjee @ 2024-09-05 13:54 UTC (permalink / raw) To: [email protected] <[email protected]> Hello All, I have to implement an incremental load from a SQL server DB to a postgresql DB. I would prefer it to be pull from postgres. SSIS is not the preferred option. Can you please advise about the possibilities? Sabyasachi Mukherjee ^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql @ 2024-09-05 14:01 Holger Jakobs <[email protected]> parent: Sabyasachi Mukherjee <[email protected]> 3 siblings, 1 reply; 6+ messages in thread From: Holger Jakobs @ 2024-09-05 14:01 UTC (permalink / raw) To: [email protected] You could try to use BCP.exe for exporting from MS SQL to a flat file per table. Load into PG SQL Server with COPY or \copy (psql). Using the TSQL foreign data wrapper to pull data over is another option. This FDW isn't very well maintained, though. Regards Holger -- Holger Jakobs, Bergisch Gladbach Tel. +49 178 9759012 Am 5. September 2024 15:54:31 MESZ schrieb Sabyasachi Mukherjee <[email protected]>: >Hello All, > >I have to implement an incremental load from a SQL server DB to a postgresql DB. I would prefer it to be pull from postgres. >SSIS is not the preferred option. Can you please advise about the possibilities? > >Sabyasachi Mukherjee ^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql @ 2024-09-05 14:11 Wasim Devale <[email protected]> parent: Sabyasachi Mukherjee <[email protected]> 3 siblings, 0 replies; 6+ messages in thread From: Wasim Devale @ 2024-09-05 14:11 UTC (permalink / raw) To: Sabyasachi Mukherjee <[email protected]>; +Cc: Pgsql-admin <[email protected]> ADF Pipeline would be great for your need. Thanks, Wasim On Thu, 5 Sept, 2024, 7:24 pm Sabyasachi Mukherjee, < [email protected]> wrote: > Hello All, > > I have to implement an incremental load from a SQL server DB to a > postgresql DB. I would prefer it to be pull from postgres. > SSIS is not the preferred option. Can you please advise about the > possibilities? > > Sabyasachi Mukherjee > ^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql @ 2024-09-05 14:56 Bo Victor Thomsen <[email protected]> parent: Holger Jakobs <[email protected]> 0 siblings, 0 replies; 6+ messages in thread From: Bo Victor Thomsen @ 2024-09-05 14:56 UTC (permalink / raw) To: [email protected] You could use the the /*ogc_fdw*/ foreign data wrapper. It's a data wrapper for accessing spatial data using the GDAL library. But it works just fine with non-spatial data too, including MS-SqlServer. And it's well maintained. Med venlig hilsen / Best regards Bo Victor Thomsen On 05-09-2024 16:01, Holger Jakobs wrote: > You could try to use BCP.exe for exporting from MS SQL to a flat file > per table. Load into PG SQL Server with COPY or \copy (psql). > > Using the TSQL foreign data wrapper to pull data over is another > option. This FDW isn't very well maintained, though. > > Regards > Holger > > -- > Holger Jakobs, Bergisch Gladbach > Tel. +49 178 9759012 > > > Am 5. September 2024 15:54:31 MESZ schrieb Sabyasachi Mukherjee > <[email protected]>: > > Hello All, > > I have to implement an incremental load from a SQL server DB to a > postgresql DB. I would prefer it to be pull from postgres. > SSIS is not the preferred option. Can you please advise about the > possibilities? > > Sabyasachi Mukherjee > ^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Incremental load from SQL server DB to postgressql @ 2024-09-06 03:44 Muhammad Usman Khan <[email protected]> parent: Sabyasachi Mukherjee <[email protected]> 3 siblings, 0 replies; 6+ messages in thread From: Muhammad Usman Khan @ 2024-09-06 03:44 UTC (permalink / raw) To: Sabyasachi Mukherjee <[email protected]>; +Cc: [email protected] <[email protected]> Hi, You can use pgloader. It is a powerful tool that can migrate data from SQL Server to PostgreSQL efficiently, and it supports incremental loads or the other option is to use file_fdw, it allows PostgreSQL to directly query flat files as if they were tables, without importing the data into PostgreSQL. It can be useful if you can periodically export data from SQL Server into flat files and then query them from PostgreSQL. On Thu, 5 Sept 2024 at 18:54, Sabyasachi Mukherjee < [email protected]> wrote: > Hello All, > > I have to implement an incremental load from a SQL server DB to a > postgresql DB. I would prefer it to be pull from postgres. > SSIS is not the preferred option. Can you please advise about the > possibilities? > > Sabyasachi Mukherjee > ^ permalink raw reply [nested|flat] 6+ messages in thread
* RE: Incremental load from SQL server DB to postgressql @ 2024-09-08 22:01 [email protected] parent: Sabyasachi Mukherjee <[email protected]> 3 siblings, 0 replies; 6+ messages in thread From: [email protected] @ 2024-09-08 22:01 UTC (permalink / raw) To: 'Sabyasachi Mukherjee' <[email protected]>; [email protected] Option use ELT tool , if PostgreSQL in Azure use Azure Data Factory Option 2 , write SQL statements to extract data in PostgreSQL format , load into PostgreSQL using \copy command If AWS use Schema Conversion Tool (SCT) along with Database Migration Services (DMS) From: Sabyasachi Mukherjee <[email protected]> Sent: Thursday, September 5, 2024 9:55 AM To: [email protected] Subject: Incremental load from SQL server DB to postgressql Hello All, I have to implement an incremental load from a SQL server DB to a postgresql DB. I would prefer it to be pull from postgres. SSIS is not the preferred option. Can you please advise about the possibilities? Sabyasachi Mukherjee ^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2024-09-08 22:01 UTC | newest] Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2024-09-05 13:54 Incremental load from SQL server DB to postgressql Sabyasachi Mukherjee <[email protected]> 2024-09-05 14:01 ` Holger Jakobs <[email protected]> 2024-09-05 14:56 ` Bo Victor Thomsen <[email protected]> 2024-09-05 14:11 ` Wasim Devale <[email protected]> 2024-09-06 03:44 ` Muhammad Usman Khan <[email protected]> 2024-09-08 22:01 ` [email protected]
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox