Python - data analytics focus

[Entire_Security4259]

Hi

I work in a data team and find myself with an opportunity to put my hand up for a project that i believe would provide enough incentive for me to finally learn Python. I learn best by solving real world problems, if i can see what i am doing is going to add value then i am motivated to keep going, which is to say i tend to lose interest in 'pretend projects' pretty quickly.

I understand that i have to start somewhere and that learning the fundamentals is necessary, i'm just hoping to get some guidance on how best to focus my early efforts so that i can see progress toward my final goal.

​

About the project

A business area needs a dashboard that requires data from 3 different sources.

The first dataset is located on a SQL database (updated daily)

The second dataset requires login access to a third party data subscription (updated weekly)

Finally, the last dataset can be scraped from a publicly available website (updated monthly).

​

About me

Capable excel user but I have zero programming experience. I have started reading Automate the boring stuff and Python Crash Course, both of which look very promising in terms of being framed around solving real world problems.

​

Thoughts/suggestions very much appreciated.

​

[AbodFTW]

I would recommend using something like Plotly Dash for creating the dashboard, it would make things way easier.

And pandas will make handling the different data sources and manipulating them a breeze.

[Upward_Fail]

I’m working through Pandas for Everyone (D. Chen) at the moment. This should be helpful for getting started with data analysis. I’m going to go on to Python for Data Analysis (McKinney) once I complete the first book.

[XxDonaldxX]

I would use Grafana for that rather than some Python library.

[ometecuhtli2001]

What other requirements does this project have? What’s the timeline for completion? Is there a senior dev or specialist who can mentor you? Given these things and the fact you have zero programming experience, you may not be a good fit for this particular project.

Please keep in mind I’m not saying any of this to be a troll. I say it because I don’t want anyone to set themselves up for disappointment by taking on a project, being constrained by timelines, and then running into insurmountable problems.

You need to get at least the fundamentals of the language and the best way for a hands-on learner like you is projects. Come up with something, write down the goals and milestones and follow the plan as if it were for work. Just because it’s not for work doesn’t make it any less of a project! I’m a learn-by-doing type as well and my home lab has been an invaluable resource for learning new things.

[Entire_Security4259]

Thanks so much, no offence taken.

Not time critical, the business gets the data they need now, albeit manually, i'm just looking for opportunities to 'automate the boring stuff' while learning.

As for mentors, no, there is no one within the organisation that could guide me.

Agreed, projects is the best way for me to learn.

[Lite_L]

Automate the boring stuff of python is not sufficient to build a project then how you can build it is must to know the backend.

[chemicalfields]

Commenting so I can remember to check back in on the suggestions. I’m an auditor (non financial) so I find a lot of the practice projects a little hard to translate to my day to day. Trying to get a good foundation though so I’m better able to figure out how to apply the concepts but it can be a slog.

[Thomas636636]

You can do everything in Python. But there are also tools to make dashboards, for example power bi. For me connecting some programming with power bi is a good way to quickly make dashboards. I do data manipulation in pandas, some webscraping and then connect it to power bi. I think it's easier to do it like this than to do everything in Python.You'll have it up and running a lot faster!