public inbox for [email protected]help / color / mirror / Atom feed
Ora2pg Delta Migration: Oracle to PostgreSQL 5+ messages / 4 participants [nested] [flat]
* Ora2pg Delta Migration: Oracle to PostgreSQL @ 2024-05-03 00:28 Amit Sharma <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Amit Sharma @ 2024-05-03 00:28 UTC (permalink / raw) To: PostgreSQL General <[email protected]> Hello, Has anyone tried delta/incremental data migration for Oracle to PostgreSQL using Ora2pg? Or what are the best options to run delta migration for Oracle to PostgreSQL? Thanks Amit ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Ora2pg Delta Migration: Oracle to PostgreSQL @ 2024-05-03 03:12 Ron Johnson <[email protected]> parent: Amit Sharma <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Ron Johnson @ 2024-05-03 03:12 UTC (permalink / raw) To: PostgreSQL General <[email protected]> On Thu, May 2, 2024 at 8:28 PM Amit Sharma <[email protected]> wrote: > Hello, > > Has anyone tried delta/incremental data migration for Oracle to PostgreSQL > using Ora2pg? Or what are the best options to run delta migration for > Oracle to PostgreSQL? > What do the ora2pg docs say about whether or not that feature is implemented? (It wasn't when I last used it in 2022.) ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Ora2pg Delta Migration: Oracle to PostgreSQL @ 2024-05-03 07:24 Muhammad Ikram <[email protected]> parent: Ron Johnson <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Muhammad Ikram @ 2024-05-03 07:24 UTC (permalink / raw) To: Ron Johnson <[email protected]>; +Cc: PostgreSQL General <[email protected]> Hi, Not related to Ora2PG but in the past I have used the EDB Migration toolkit for such scenarios. Filterprops option can help in specifying filter (where clause). Regards, Ikram On Fri, May 3, 2024 at 8:12 AM Ron Johnson <[email protected]> wrote: > On Thu, May 2, 2024 at 8:28 PM Amit Sharma <[email protected]> wrote: > >> Hello, >> >> Has anyone tried delta/incremental data migration for Oracle to >> PostgreSQL using Ora2pg? Or what are the best options to run delta >> migration for Oracle to PostgreSQL? >> > > What do the ora2pg docs say about whether or not that feature is > implemented? (It wasn't when I last used it in 2022.) > > -- Muhammad Ikram ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Ora2pg Delta Migration: Oracle to PostgreSQL @ 2024-05-03 09:38 Avinash Vallarapu <[email protected]> parent: Muhammad Ikram <[email protected]> 0 siblings, 1 reply; 5+ messages in thread From: Avinash Vallarapu @ 2024-05-03 09:38 UTC (permalink / raw) To: Muhammad Ikram <[email protected]>; Amit Sharma <[email protected]>; +Cc: Ron Johnson <[email protected]>; PostgreSQL General <[email protected]> Hi, Has anyone tried delta/incremental data migration for Oracle to PostgreSQL > using Ora2pg? Or what are the best options to run delta migration for > Oracle to PostgreSQL? There are a few ways of dealing with it when using Ora2Pg. *Option 1 : *Ora2Pg configuration file allows us to pass the conditions(predicates) to be applied to a table while migrating the data from a table. So, if there is a way to filter the data since the last full load, you can pass the condition to the configuration file, for each table. This is some work for sure but it works great if you are able to identify those conditions such as creation_date or last_updated_date, let's say. *Option2 :* Ora2Pg is currently CDC ready. What this means is that, Ora2Pg can provide the SCN at which the table copy has been initiated. Technically, we provide the SCN to the CDC tools or custom CDC techniques to continue replication since that SCN. *Option 2.1 :* Leverage Debezium, an Open Source solution to perform continuous replication from Oracle to PostgreSQL from the SCN produced by Ora2Pg for that table. So, it is all about Ora2Pg + Debezium It might be initially challenging, but you will get there. Regards, Avi Vallarapu, CEO, HexaCluster Corp. On Fri, May 3, 2024 at 3:25 AM Muhammad Ikram <[email protected]> wrote: > Hi, > > Not related to Ora2PG but in the past I have used the EDB Migration > toolkit for such scenarios. Filterprops option can help in specifying > filter (where clause). > > Regards, > Ikram > > > On Fri, May 3, 2024 at 8:12 AM Ron Johnson <[email protected]> > wrote: > >> On Thu, May 2, 2024 at 8:28 PM Amit Sharma <[email protected]> wrote: >> >>> Hello, >>> >>> Has anyone tried delta/incremental data migration for Oracle to >>> PostgreSQL using Ora2pg? Or what are the best options to run delta >>> migration for Oracle to PostgreSQL? >>> >> >> What do the ora2pg docs say about whether or not that feature is >> implemented? (It wasn't when I last used it in 2022.) >> >> > > > -- > Muhammad Ikram > > ^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: Ora2pg Delta Migration: Oracle to PostgreSQL @ 2024-05-03 14:19 Amit Sharma <[email protected]> parent: Avinash Vallarapu <[email protected]> 0 siblings, 0 replies; 5+ messages in thread From: Amit Sharma @ 2024-05-03 14:19 UTC (permalink / raw) To: Avinash Vallarapu <[email protected]>; +Cc: Muhammad Ikram <[email protected]>; Ron Johnson <[email protected]>; PostgreSQL General <[email protected]> Thanks Avinash. Appriciate the help!! Regards Amit On Fri, May 3, 2024 at 5:38 AM Avinash Vallarapu < [email protected]> wrote: > Hi, > > Has anyone tried delta/incremental data migration for Oracle to PostgreSQL >> using Ora2pg? Or what are the best options to run delta migration for >> Oracle to PostgreSQL? > > > There are a few ways of dealing with it when using Ora2Pg. > > *Option 1 : *Ora2Pg configuration file allows us to pass the > conditions(predicates) to be applied to a table while migrating the data > from a table. So, if there is a way to filter the data since the last full > load, you can pass the condition to the configuration file, for each table. > This is some work for sure but it works great if you are able to identify > those conditions such as creation_date or last_updated_date, let's say. > > *Option2 :* Ora2Pg is currently CDC ready. What this means is that, > Ora2Pg can provide the SCN at which the table copy has been initiated. > Technically, we provide the SCN to the CDC tools or custom CDC techniques > to continue replication since that SCN. > > *Option 2.1 :* Leverage Debezium, an Open Source solution to perform > continuous replication from Oracle to PostgreSQL from the SCN produced by > Ora2Pg for that table. > > So, it is all about Ora2Pg + Debezium > > It might be initially challenging, but you will get there. > > Regards, > Avi Vallarapu, > CEO, > HexaCluster Corp. > > > > > > > On Fri, May 3, 2024 at 3:25 AM Muhammad Ikram <[email protected]> wrote: > >> Hi, >> >> Not related to Ora2PG but in the past I have used the EDB Migration >> toolkit for such scenarios. Filterprops option can help in specifying >> filter (where clause). >> >> Regards, >> Ikram >> >> >> On Fri, May 3, 2024 at 8:12 AM Ron Johnson <[email protected]> >> wrote: >> >>> On Thu, May 2, 2024 at 8:28 PM Amit Sharma <[email protected]> wrote: >>> >>>> Hello, >>>> >>>> Has anyone tried delta/incremental data migration for Oracle to >>>> PostgreSQL using Ora2pg? Or what are the best options to run delta >>>> migration for Oracle to PostgreSQL? >>>> >>> >>> What do the ora2pg docs say about whether or not that feature is >>> implemented? (It wasn't when I last used it in 2022.) >>> >>> >> >> >> -- >> Muhammad Ikram >> >> > ^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2024-05-03 14:19 UTC | newest] Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2024-05-03 00:28 Ora2pg Delta Migration: Oracle to PostgreSQL Amit Sharma <[email protected]> 2024-05-03 03:12 ` Ron Johnson <[email protected]> 2024-05-03 07:24 ` Muhammad Ikram <[email protected]> 2024-05-03 09:38 ` Avinash Vallarapu <[email protected]> 2024-05-03 14:19 ` Amit Sharma <[email protected]>
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox