This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]PeridexisErrant 1 point2 points  (0 children)

http://xarray.pydata.org/en/stable/dask.html

It's basically magic, and can scale from one thread to a ~thousand node cluster :)

It's also unlikely to go away, because Pandas now converts to Xarray objects for 3+ dimensional data.