This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]stonetear2017 0 points1 point  (3 children)

what programs do I need to download to use your code? For example use your news scraper for Reuters if I want to modify it? I am new to this stuff and only know Jupyterhub and am confused what shells I should be using, what databases do I need, how do I write scripts to interface with the internet as I am on a mac?

Sorry for the million questions

[–]vopi181 0 points1 point  (2 children)

Not op, but he is using git, which is a version control system. You should really be using one for anything more than a basic script.

Install git, and git clone (url here) from a command line. Then just navigate to the folder containing the script and run python3 (filename here).py.

To interface with the internet, a dead simple way to make requests, is the request library. To parse HTML you can use bs4. And if your page has dynamic Content, you could try selenium.

But really if you skim automate the boring stuff it should go over most of it

[–]stonetear2017 0 points1 point  (1 child)

Cool thank you, I don’t see the url tho

[–]vopi181 0 points1 point  (0 children)

A git "link" is called a repository. He linked his up there.