public inbox for [email protected]help / color / mirror / Atom feed
Re: Destination Table - Condition Amount 0 3+ messages / 3 participants [nested] [flat]
* Re: Destination Table - Condition Amount 0 @ 2024-08-08 18:07 Anthony Apollis <[email protected]> 0 siblings, 2 replies; 3+ messages in thread From: Anthony Apollis @ 2024-08-08 18:07 UTC (permalink / raw) To: Adrian Klaver <[email protected]>; +Cc: [email protected] The same code bring in values for FY24, 23 etc. Dont understand why FY25's values are 0. On Thu, 8 Aug 2024 at 18:56, Adrian Klaver <[email protected]> wrote: > On 8/8/24 09:35, Anthony Apollis wrote: > > I need your assistance with an ETL process that runs every six months. > > Currently, we are in Calendar Year/FY 2025, which started in July 2024. > > > > The issue is with the "Condition Amount" for FY 2025. Data comes through > > correctly until the "Insert Data Into Task" step (please see the > > attached screenshot). However, it appears that the code responsible for > > the "Update PD Credit" step is not functioning as expected. > > > > image.png > > > > > > The destination table [Turkey - NCD Revenue Reporting Model_Table_Model] > > is receiving data for FY 2025, but the "*Condition Amount*" column > > contains zeros for 2025. Please see the attached sample data for > reference. > > > > To help diagnose the issue, I have included the following: > > > > DDL for all three tables. > > > > Insert/Update scripts for the two tasks as depicted in the screenshot > above. > > > > Sample raw data for the two tables. > > > > SSIS can also be found attached for better understanding > > > > Sample data for the "Insert Data Into > > > > Honestly I have not looked through all the files and probably won't. I > did find this though: > > CASE > WHEN NCD_EXCL."Order Quantity" IS NULL OR NCD_EXCL."Order > Quantity" LIKE 'Excluded' THEN > 0 > WHEN NCD_EXCL."Order Quantity" LIKE 'NCD Valid' THEN > NCD_AMOUNT."Condition Amount" > ELSE > 0 > > which looks suspicious in that it can turn a "Condition Amount" into 0. > > I would start by running the SELECT that this is part of and seeing what > it does to the data and if that is what you want it to do. > > -- > Adrian Klaver > [email protected] > > ^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Destination Table - Condition Amount 0 @ 2024-08-08 18:48 Alban Hertroys <[email protected]> parent: Anthony Apollis <[email protected]> 1 sibling, 0 replies; 3+ messages in thread From: Alban Hertroys @ 2024-08-08 18:48 UTC (permalink / raw) To: Anthony Apollis <[email protected]>; +Cc: Adrian Klaver <[email protected]>; pgsql-general <[email protected]> > On 8 Aug 2024, at 20:07, Anthony Apollis <[email protected]> wrote: > > The same code bring in values for FY24, 23 etc. Dont understand why FY25's values are 0. If you use the same code for FY24, then either there’s some filter being applied somewhere that excludes FY25 (and probably beyond), or something in your data changed. My bet is on the latter. For example, in FY25 the value of NCD_EXCL."Order Quantity" is 'NCD Valid FY25’, which doesn’t match your LIKE expression. Even something like a trailing space to the value could be enough. Alban Hertroys -- There is always an exception to always. ^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Destination Table - Condition Amount 0 @ 2024-08-08 19:01 Adrian Klaver <[email protected]> parent: Anthony Apollis <[email protected]> 1 sibling, 0 replies; 3+ messages in thread From: Adrian Klaver @ 2024-08-08 19:01 UTC (permalink / raw) To: Anthony Apollis <[email protected]>; +Cc: [email protected] On 8/8/24 11:07, Anthony Apollis wrote: > The same code bring in values for FY24, 23 etc. Dont understand why > FY25's values are 0. Because something changed. You will need to go through the process step by step and verify that the code is current with what is in the FY25 data. -- Adrian Klaver [email protected] ^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2024-08-08 19:01 UTC | newest] Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed) -- links below jump to the message on this page -- 2024-08-08 18:07 Re: Destination Table - Condition Amount 0 Anthony Apollis <[email protected]> 2024-08-08 18:48 ` Alban Hertroys <[email protected]> 2024-08-08 19:01 ` Adrian Klaver <[email protected]>
This inbox is served by agora; see mirroring instructions for how to clone and mirror all data and code used for this inbox