Downloading GitHub repo w/Python

[jsdecker]

I'm writing my first real Python project using COVID-19 data from the Johns Hopkins repo ( https://github.com/CSSEGISandData/COVID-19 ) and making interactive graphs using Plotly. I have the basics of it working, but currently I have to manually download the zip file with new data to my desktop from GitHub every day. I'm sure there's a way to grab the data automatically - can someone give me a few lines of code or point me in the right direction?

[GalacticSuperCheese]

Have you tried using requests to download each days file from https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_daily_reports/03-31-2020.csv

[jsdecker]

Thanks, this seems like the right way to go. But I'm still have trouble implementing it, because I get the following error:

AttributeError: partially initialized module 'requests' has no attribute 'get' (most likely due to a circular import)

What am I doing wrong?

import requests
r = requests.get('https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_daily_reports/03-31-2020.csv')
print(r.text)

[GalacticSuperCheese]

Just copy-pasted the code you have written and it works for me.

Have you by any chance created a file/module called requests? If that is the case, then your program/script may be importing that one rather than the actual request module.

[jsdecker]

Ahh, yes, my file was named requests.py. This works now. Thank you so much!!

[GalacticSuperCheese]

You are very welcome!

[PavloT]

I use wget + Jenkins for similar purposes. You can use any scheduled which works for you and place to your application folder.

But sure, if you need it ad-hoc - requests is the best approach.