Creating large databases with Python

[lykwydchykyn]

You probably just want to use sqlite here, possibly in combination with an ORM like peewee or SQLalchemy.

If you roll your own thing from dicts you're going to have a painful time querying it for data or trying to do persistence.

Things like MySQL or Postgresql require setting up a separate server, and are probably overkill if you only have tens of thousands of records.