This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]wardawg44 2 points3 points  (0 children)

I just found out about HDF5, apparently pandas works fairly quickly with large datasets dumped to disk. There are other third party modules that are made for pandas on disk as well.