MIME-Version: 1.0
References: <CAHER7LrDGLmmB6SGiQh7prAJ4pQy7QczoPa2EcJ4zkFTTTZ61A@mail.gmail.com>
 <CANzqJaCb=aEycqm7hQEUc-NAeNVqDdGAeetTOmG4qWOTx7GgkQ@mail.gmail.com>
 <CAGeimVqZ0=n+yPc6O67+08QBS1Gjpz_U7enJAK5ADPQ7pWxaAw@mail.gmail.com> <CAN0TujeJgfuMByPcMy+H_w1ZuwUpi7djnnwyYtMA2Cvp_gpgQg@mail.gmail.com>
In-Reply-To: <CAN0TujeJgfuMByPcMy+H_w1ZuwUpi7djnnwyYtMA2Cvp_gpgQg@mail.gmail.com>
From: Amit Sharma <amitpgsql@gmail.com>
Date: Fri, 3 May 2024 10:19:00 -0400
Message-ID: <CAHER7LoShOckUN5ET8xzkVOkNK650LRVwqSKRJ-=5_hr-cZqzA@mail.gmail.com>
Subject: Re: Ora2pg Delta Migration: Oracle to PostgreSQL
To: Avinash Vallarapu <avinash.vallarapu@gmail.com>
Cc: Muhammad Ikram <mmikram@gmail.com>, Ron Johnson <ronljohnsonjr@gmail.com>, 
	PostgreSQL General <pgsql-general@lists.postgresql.org>
Content-Type: multipart/alternative; boundary="00000000000055aa7e06178d6725"
Archived-At: <https://www.postgresql.org/message-id/CAHER7LoShOckUN5ET8xzkVOkNK650LRVwqSKRJ-%3D5_hr-cZqzA%40mail.gmail.com>
Precedence: bulk

--00000000000055aa7e06178d6725
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thanks Avinash. Appriciate the help!!

Regards
Amit


On Fri, May 3, 2024 at 5:38=E2=80=AFAM Avinash Vallarapu <
avinash.vallarapu@gmail.com> wrote:

> Hi,
>
> Has anyone tried delta/incremental data migration for Oracle to PostgreSQ=
L
>> using Ora2pg? Or what are the best options to run delta migration for
>> Oracle to PostgreSQL?
>
>
> There are a few ways of dealing with it when using Ora2Pg.
>
> *Option 1 : *Ora2Pg configuration file allows us to pass the
> conditions(predicates) to be applied to a table while migrating the data
> from a table. So, if there is a way to filter the data since the last ful=
l
> load, you can pass the condition to the configuration file, for each tabl=
e.
> This is some work for sure but it works great if you are able to identify
> those conditions such as creation_date or last_updated_date, let's say.
>
> *Option2 :* Ora2Pg is currently CDC ready. What this means is that,
> Ora2Pg can provide the SCN at which the table copy has been initiated.
> Technically, we provide the SCN to the CDC tools or custom CDC techniques
> to continue replication since that SCN.
>
> *Option 2.1 :* Leverage Debezium, an Open Source solution to perform
> continuous replication from Oracle to PostgreSQL from the SCN produced by
> Ora2Pg for that table.
>
> So, it is all about Ora2Pg + Debezium
>
> It might be initially challenging, but you will get there.
>
> Regards,
> Avi Vallarapu,
> CEO,
> HexaCluster Corp.
>
>
>
>
>
>
> On Fri, May 3, 2024 at 3:25=E2=80=AFAM Muhammad Ikram <mmikram@gmail.com>=
 wrote:
>
>> Hi,
>>
>> Not related to Ora2PG but in the past I have used the EDB Migration
>> toolkit for such scenarios. Filterprops option can help in specifying
>> filter (where clause).
>>
>> Regards,
>> Ikram
>>
>>
>> On Fri, May 3, 2024 at 8:12=E2=80=AFAM Ron Johnson <ronljohnsonjr@gmail.=
com>
>> wrote:
>>
>>> On Thu, May 2, 2024 at 8:28=E2=80=AFPM Amit Sharma <amitpgsql@gmail.com=
> wrote:
>>>
>>>> Hello,
>>>>
>>>> Has anyone tried delta/incremental data migration for Oracle to
>>>> PostgreSQL using Ora2pg? Or what are the best options to run delta
>>>> migration for Oracle to PostgreSQL?
>>>>
>>>
>>> What do the ora2pg docs say about whether or not that feature is
>>> implemented?  (It wasn't when I last used it in 2022.)
>>>
>>>
>>
>>
>> --
>> Muhammad Ikram
>>
>>
>

--00000000000055aa7e06178d6725
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Thanks=C2=A0Avinash. Appriciate the help!!<div><br></div><=
div>Regards</div><div>Amit</div><div><br></div></div><br><div class=3D"gmai=
l_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, May 3, 2024 at 5:38=
=E2=80=AFAM Avinash Vallarapu &lt;<a href=3D"mailto:avinash.vallarapu@gmail=
.com">avinash.vallarapu@gmail.com</a>&gt; wrote:<br></div><blockquote class=
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;bo=
rder-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">=
<div dir=3D"ltr"><div dir=3D"ltr"><div>Hi,</div><div><br></div><blockquote =
class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1=
px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:=
1ex">Has anyone tried delta/incremental data migration for Oracle to Postgr=
eSQL using Ora2pg? Or what are the best options to run delta migration for =
Oracle to PostgreSQL?</blockquote><div><br></div><div>There are a few ways =
of dealing with it when using Ora2Pg.</div><div><br></div><div><b>Option 1 =
: </b>Ora2Pg configuration file allows us to pass the conditions(predicates=
) to be=C2=A0applied to a table while migrating the data from a table. So, =
if there is a way to filter the data since the last full load, you can pass=
 the condition to the configuration file, for each table. This is some work=
 for sure but it works great if you are able to identify those conditions s=
uch=C2=A0as creation_date or last_updated_date, let&#39;s say.</div><div><b=
r></div><div><b>Option2 :</b> Ora2Pg is currently CDC ready. What this mean=
s is that, Ora2Pg can provide the SCN at which the table copy has been init=
iated. Technically, we provide the SCN to the CDC tools or custom CDC techn=
iques to continue replication since that SCN.</div><div><b><br></b></div><d=
iv><b>Option 2.1 :</b> Leverage Debezium, an Open Source solution to perfor=
m continuous replication from Oracle to PostgreSQL from the SCN produced by=
 Ora2Pg for that table.</div><div><br></div><div>So, it is all about Ora2Pg=
=C2=A0+ Debezium</div><div><br></div><div>It might be initially challenging=
, but you will get there.=C2=A0</div><div><br></div><div>Regards,</div><div=
>Avi Vallarapu,</div><div>CEO,=C2=A0</div><div>HexaCluster Corp.=C2=A0</div=
><div><br></div><div><br></div><div>=C2=A0</div><div><br></div><div><br></d=
iv></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_att=
r">On Fri, May 3, 2024 at 3:25=E2=80=AFAM Muhammad Ikram &lt;<a href=3D"mai=
lto:mmikram@gmail.com" target=3D"_blank">mmikram@gmail.com</a>&gt; wrote:<b=
r></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex=
;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,20=
4,204);padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div>Not relate=
d to Ora2PG but in the past I have used the EDB Migration toolkit for such =
scenarios. Filterprops option can help in specifying filter (where clause).=
</div><div><br></div><div>Regards,</div><div>Ikram</div><div><br></div></di=
v><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On F=
ri, May 3, 2024 at 8:12=E2=80=AFAM Ron Johnson &lt;<a href=3D"mailto:ronljo=
hnsonjr@gmail.com" target=3D"_blank">ronljohnsonjr@gmail.com</a>&gt; wrote:=
<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8=
ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,=
204,204);padding-left:1ex"><div dir=3D"ltr"><div dir=3D"ltr">On Thu, May 2,=
 2024 at 8:28=E2=80=AFPM Amit Sharma &lt;<a href=3D"mailto:amitpgsql@gmail.=
com" target=3D"_blank">amitpgsql@gmail.com</a>&gt; wrote:<br></div><div cla=
ss=3D"gmail_quote"><blockquote class=3D"gmail_quote" style=3D"margin:0px 0p=
x 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color=
:rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr">Hello,<div><br></div><=
div>Has anyone tried delta/incremental data migration for Oracle to Postgre=
SQL using Ora2pg? Or what are the best options to run delta migration for O=
racle to PostgreSQL?</div></div></blockquote><div><br></div><div>What do th=
e ora2pg docs say about whether or not that feature is implemented?=C2=A0 (=
It wasn&#39;t when I last used it in 2022.)</div><div>=C2=A0<br></div></div=
></div>
</blockquote></div><br clear=3D"all"><div><br></div><span class=3D"gmail_si=
gnature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><d=
iv dir=3D"ltr"><div>Muhammad Ikram<br><br></div></div></div>
</blockquote></div><div><br></div></div>
</blockquote></div>

--00000000000055aa7e06178d6725--