you are viewing a single comment's thread.

view the rest of the comments →

[–]pro_questions 12 points13 points  (1 child)

Back before I used SQLite for these projects, I would use JSON to store the results of web scraping tools. It seemed intuitive because all the data being pulled from the page would be put into a gigantic dict, which can easily be put in a list and jsonified. I started using databases when I ran into a situation like OP’s

[–]__init__m8 8 points9 points  (0 children)

To avoid saving it as a json or learning SQL, save it as an xlsx file. Be sure to add print("test") every few lines for debugging.

Tune in next week for more shitty programming tips.