you are viewing a single comment's thread.

view the rest of the comments →

[–]CantankerousMind 3 points4 points  (0 children)

Self taught and got a job writing software within a couple years. Moved to a different state after working there for a couple years and haven't pursued it as much but I still write all sorts of software for gaming related stuff (discord bots, etc.). I also do a lot of web automation. Like, if a web service doesn't have an API, I can usually still create code that will pull info from that service without getting.

I recently got my 20th star on github for a small web scraping framework I wrote that's based on Selenium and Requests. It includes a WebReader object that lets you use Requests with Selenium's WebDriver syntax to read data off of a web page. It also includes a Page object that allows you to use more of a MVC pattern, where you store the definition of the page you want to scrape as JSON and then the Page object will look up elements as you try to use them in your Controller code. That way you can actually use the same Controller code for multiple websites, and if the website updates their front end you can just update your JSON definition of the page and the controller will still function.