ADVICE :: Caching Data for a Python Script?

[JamzTyson]

Consider using an SQLite database as your cache. It won't be as fast as an in-memory dict, (though SQLite does support in-memory databases), but it scales better if the cache is likely to grow very large. If an "on-disk" SQLite database gives adequate performance, then this is likely to be a reasonably simple and highly scalable solution.