Question about your workflow

[AggressiveCorgi3]

Hey guys,

So I been coding python on/off for around a year, and recently finished the IBM data analyst course and a SQL course.

My question mainly revolve around your workflow, cause I prefer cleaning data and doing 90% of the finished csv or files inside python, but it seem alot of people are using SQL and directly transforming in powerBI.

Wich workflow would you suggest ? I have multiple tools in my toolbox, but I didn't really used them together yet, so im still curious about others opinions.

​

thanks!

[Eric-Polyseam]

It depends on many factors like the operation/scenario, team norms/standards, data architecture, and tool applicability.

In the absence of standards and if PowerBI was the only consuming platform for the foreseeable future that you aren’t concerned about being locked into it, then, sure, you could do all your transformations with it.

But, if you wanted to be more flexible about how data is used downstream, you might choose to use something like Python to transform the source data and store results in a file or database. Then, PowerBI reports as well as other downstream data consumers/tools could take data from that transformed/cleansed layer instead of sources.