public inbox for [email protected]  

help / color / mirror / Atom feed

From: Amit Sharma <[email protected]>
To: Avinash Vallarapu <[email protected]>
Cc: Muhammad Ikram <[email protected]>
Cc: Ron Johnson <[email protected]>
Cc: PostgreSQL General <[email protected]>
Subject: Re: Ora2pg Delta Migration: Oracle to PostgreSQL
Date: Fri, 3 May 2024 10:19:00 -0400
Message-ID: <CAHER7LoShOckUN5ET8xzkVOkNK650LRVwqSKRJ-=5_hr-cZqzA@mail.gmail.com> (raw)
In-Reply-To: <CAN0TujeJgfuMByPcMy+H_w1ZuwUpi7djnnwyYtMA2Cvp_gpgQg@mail.gmail.com>
References: <CAHER7LrDGLmmB6SGiQh7prAJ4pQy7QczoPa2EcJ4zkFTTTZ61A@mail.gmail.com>
	<CANzqJaCb=aEycqm7hQEUc-NAeNVqDdGAeetTOmG4qWOTx7GgkQ@mail.gmail.com>
	<CAGeimVqZ0=n+yPc6O67+08QBS1Gjpz_U7enJAK5ADPQ7pWxaAw@mail.gmail.com>
	<CAN0TujeJgfuMByPcMy+H_w1ZuwUpi7djnnwyYtMA2Cvp_gpgQg@mail.gmail.com>

Thanks Avinash. Appriciate the help!!

Regards
Amit


On Fri, May 3, 2024 at 5:38 AM Avinash Vallarapu <
[email protected]> wrote:

> Hi,
>
> Has anyone tried delta/incremental data migration for Oracle to PostgreSQL
>> using Ora2pg? Or what are the best options to run delta migration for
>> Oracle to PostgreSQL?
>
>
> There are a few ways of dealing with it when using Ora2Pg.
>
> *Option 1 : *Ora2Pg configuration file allows us to pass the
> conditions(predicates) to be applied to a table while migrating the data
> from a table. So, if there is a way to filter the data since the last full
> load, you can pass the condition to the configuration file, for each table.
> This is some work for sure but it works great if you are able to identify
> those conditions such as creation_date or last_updated_date, let's say.
>
> *Option2 :* Ora2Pg is currently CDC ready. What this means is that,
> Ora2Pg can provide the SCN at which the table copy has been initiated.
> Technically, we provide the SCN to the CDC tools or custom CDC techniques
> to continue replication since that SCN.
>
> *Option 2.1 :* Leverage Debezium, an Open Source solution to perform
> continuous replication from Oracle to PostgreSQL from the SCN produced by
> Ora2Pg for that table.
>
> So, it is all about Ora2Pg + Debezium
>
> It might be initially challenging, but you will get there.
>
> Regards,
> Avi Vallarapu,
> CEO,
> HexaCluster Corp.
>
>
>
>
>
>
> On Fri, May 3, 2024 at 3:25 AM Muhammad Ikram <[email protected]> wrote:
>
>> Hi,
>>
>> Not related to Ora2PG but in the past I have used the EDB Migration
>> toolkit for such scenarios. Filterprops option can help in specifying
>> filter (where clause).
>>
>> Regards,
>> Ikram
>>
>>
>> On Fri, May 3, 2024 at 8:12 AM Ron Johnson <[email protected]>
>> wrote:
>>
>>> On Thu, May 2, 2024 at 8:28 PM Amit Sharma <[email protected]> wrote:
>>>
>>>> Hello,
>>>>
>>>> Has anyone tried delta/incremental data migration for Oracle to
>>>> PostgreSQL using Ora2pg? Or what are the best options to run delta
>>>> migration for Oracle to PostgreSQL?
>>>>
>>>
>>> What do the ora2pg docs say about whether or not that feature is
>>> implemented?  (It wasn't when I last used it in 2022.)
>>>
>>>
>>
>>
>> --
>> Muhammad Ikram
>>
>>
>

view thread (5+ messages)

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected], [email protected]
  Subject: Re: Ora2pg Delta Migration: Oracle to PostgreSQL
  In-Reply-To: <CAHER7LoShOckUN5ET8xzkVOkNK650LRVwqSKRJ-=5_hr-cZqzA@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox