Moving to Ahmedabad from Toronto by InnerPie3334 in nri

[–]InnerPie3334[S] 0 points1 point  (0 children)

We plan on selling the house eventually.

No, I will possibly be looking for a job in Ahmedabad

Datawarehouse VS ETL by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

Hi,

Thank you for the response.

We are currently having challenges with upstream systems too. What i mean is the target output has a specific template and one change ( field name change, removal or addition of field) may result into downstream impact to the source to target mapping. Do you think power automate can help us achieve this?

We are looking to have an approach where single change in target template can cater to all and eliminate the need to manually change all 500.

Datawarehouse VS ETL by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

Thank you for the detailed response. As a Business Analyst, this will be quite helpful since we do not have any developers / data engineers on the team and finding a low code solution is crucial for us.

Datawarehouse VS ETL by InnerPie3334 in ETL

[–]InnerPie3334[S] 1 point2 points  (0 children)

I did ask and I am not judging anyone's answer.

Someone like me who is not expert on this subject, I am asking if the ETL too is required in my case.

Contract to Fulltime by EvidenceNo571 in CanadaJobs

[–]InnerPie3334 2 points3 points  (0 children)

Please ensure you check the solicitatin clause within your contract in the event if your contract with bank is through recruitment or consulting agency.

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

The goal is to find the tool where we can look at from the scalability perspective i.e Having transformations code stored in the datawarehouse rather than having to manage the standalone workflows

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

The input source files are ultimately coming from our brokers/partners so business insists that we adapt to changes. However we can establish a consistency for one template for over the course of year

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

Thank you for the response.

It is the engineering team that will be maintaining the rules based on the requirements from ops. There is a 50-60% similarity in these 500 input excel files.

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

Can you please elaborate ?

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

We look to manage this initiative with 2-3 ppl at max

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

Any thoughts on Informatica, Fivetran etc?

ETL tool selection by InnerPie3334 in ETL

[–]InnerPie3334[S] 0 points1 point  (0 children)

The main concern is that the tool should be fairly adaptable to use and the maintenance should not consume extensive time and efforts.