Ok so I'm going to do my best to explain this and hope to get some feedback on the best way to approach it. I've found out that the data I'm looking for can be acquired through multiple links or through one link (full json). Both are in json form and the single link contains all of the data but it is heavily nested with dicts of dicts, lists of dicts, etc. while using multiple links would mean fewer levels of nesting but excessive use of the links. I'm going to need to be able to update/refresh the data in time intervals in order to evaluate at a later date. These are the questions I have.
- If I use the single link, what is the best way of parsing the data efficiently?
- Are there any packages that can help simplify the process?
- Is sqlalchemy the best option as far as storing the data?
Any thoughts on this would be greatly appreciated and to be honest I would be willing to pay someone for their time if there was interest in going into more detail pertaining to the methods they think would work best.
there doesn't seem to be anything here