MIME-Version: 1.0
References: <CAJyMCYJ9GJvJoY9MGvzyf-gO9ZnAwVrZSgrPfn0dGaChdb93HA@mail.gmail.com>
 <adddb99c-448a-4a6e-a1d1-ab8c50b6c073@aklaver.com>
In-Reply-To: <adddb99c-448a-4a6e-a1d1-ab8c50b6c073@aklaver.com>
From: Anthony Apollis <anthony.apollis@gmail.com>
Date: Thu, 8 Aug 2024 20:07:04 +0200
Message-ID: <CAJyMCYKmmuGDjbWgnBCLxh4y1YpggG7F_5ZxPRz4v1ERysjB0Q@mail.gmail.com>
Subject: Re: Destination Table - Condition Amount 0
To: Adrian Klaver <adrian.klaver@aklaver.com>
Cc: pgsql-general@lists.postgresql.org
Content-Type: multipart/alternative; boundary="00000000000091a5a1061f2fe59c"
Archived-At: <https://www.postgresql.org/message-id/CAJyMCYKmmuGDjbWgnBCLxh4y1YpggG7F_5ZxPRz4v1ERysjB0Q%40mail.gmail.com>
Precedence: bulk

--00000000000091a5a1061f2fe59c
Content-Type: text/plain; charset="UTF-8"

The same code bring in values for FY24, 23 etc. Dont understand why FY25's
values are 0.

On Thu, 8 Aug 2024 at 18:56, Adrian Klaver <adrian.klaver@aklaver.com>
wrote:

> On 8/8/24 09:35, Anthony Apollis wrote:
> > I need your assistance with an ETL process that runs every six months.
> > Currently, we are in Calendar Year/FY 2025, which started in July 2024.
> >
> > The issue is with the "Condition Amount" for FY 2025. Data comes through
> > correctly until the "Insert Data Into Task" step (please see the
> > attached screenshot). However, it appears that the code responsible for
> > the "Update PD Credit" step is not functioning as expected.
> >
> > image.png
> >
> >
> > The destination table [Turkey - NCD Revenue Reporting Model_Table_Model]
> > is receiving data for FY 2025, but the "*Condition Amount*" column
> > contains zeros for 2025. Please see the attached sample data for
> reference.
> >
> > To help diagnose the issue, I have included the following:
> >
> > DDL for all three tables.
> >
> > Insert/Update scripts for the two tasks as depicted in the screenshot
> above.
> >
> > Sample raw data for the two tables.
> >
> > SSIS can also be found attached for better understanding
> >
> > Sample data for the "Insert Data Into
> >
>
> Honestly I have not looked through all the files and probably won't. I
> did find this though:
>
> CASE
>          WHEN NCD_EXCL."Order Quantity" IS NULL OR NCD_EXCL."Order
> Quantity" LIKE 'Excluded' THEN
>              0
>          WHEN NCD_EXCL."Order Quantity" LIKE 'NCD Valid' THEN
>              NCD_AMOUNT."Condition Amount"
>          ELSE
>              0
>
> which looks suspicious in that it can turn a "Condition Amount" into 0.
>
> I would start by running the SELECT that this is part of and seeing what
> it does to the data and if that is what you want it to do.
>
> --
> Adrian Klaver
> adrian.klaver@aklaver.com
>
>

--00000000000091a5a1061f2fe59c
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">The same code bring in values for FY24, 23 etc. Dont under=
stand why FY25&#39;s values are 0.</div><br><div class=3D"gmail_quote"><div=
 dir=3D"ltr" class=3D"gmail_attr">On Thu, 8 Aug 2024 at 18:56, Adrian Klave=
r &lt;<a href=3D"mailto:adrian.klaver@aklaver.com">adrian.klaver@aklaver.co=
m</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"margin=
:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"=
>On 8/8/24 09:35, Anthony Apollis wrote:<br>
&gt; I need your assistance with an ETL process that runs every six months.=
 <br>
&gt; Currently, we are in Calendar Year/FY 2025, which started in July 2024=
.<br>
&gt; <br>
&gt; The issue is with the &quot;Condition Amount&quot; for FY 2025. Data c=
omes through <br>
&gt; correctly until the &quot;Insert Data Into Task&quot; step (please see=
 the <br>
&gt; attached screenshot). However, it appears that the code responsible fo=
r <br>
&gt; the &quot;Update PD Credit&quot; step is not functioning as expected.<=
br>
&gt; <br>
&gt; image.png<br>
&gt; <br>
&gt; <br>
&gt; The destination table [Turkey - NCD Revenue Reporting Model_Table_Mode=
l] <br>
&gt; is receiving data for FY 2025, but the &quot;*Condition Amount*&quot; =
column <br>
&gt; contains zeros for 2025. Please see the attached sample data for refer=
ence.<br>
&gt; <br>
&gt; To help diagnose the issue, I have included the following:<br>
&gt; <br>
&gt; DDL for all three tables.<br>
&gt; <br>
&gt; Insert/Update scripts for the two tasks as depicted in the screenshot =
above.<br>
&gt; <br>
&gt; Sample raw data for the two tables.<br>
&gt; <br>
&gt; SSIS can also be found attached for better understanding<br>
&gt; <br>
&gt; Sample data for the &quot;Insert Data Into<br>
&gt; <br>
<br>
Honestly I have not looked through all the files and probably won&#39;t. I =
<br>
did find this though:<br>
<br>
CASE<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0WHEN NCD_EXCL.&quot;Order Quantity&quot; =
IS NULL OR NCD_EXCL.&quot;Order <br>
Quantity&quot; LIKE &#39;Excluded&#39; THEN<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0WHEN NCD_EXCL.&quot;Order Quantity&quot; =
LIKE &#39;NCD Valid&#39; THEN<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0NCD_AMOUNT.&quot;Condition =
Amount&quot;<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ELSE<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00<br>
<br>
which looks suspicious in that it can turn a &quot;Condition Amount&quot; i=
nto 0.<br>
<br>
I would start by running the SELECT that this is part of and seeing what <b=
r>
it does to the data and if that is what you want it to do.<br>
<br>
-- <br>
Adrian Klaver<br>
<a href=3D"mailto:adrian.klaver@aklaver.com" target=3D"_blank">adrian.klave=
r@aklaver.com</a><br>
<br>
</blockquote></div>

--00000000000091a5a1061f2fe59c--