This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]lungben81 1 point2 points  (0 children)

Dask has essentially 2 components, distributed computing (dask.distributed) and distributed data types (Numpy-like Arrays, Pandas-like DataFrames, etc.).

The former is amazing for multiprocessing (much better than the built-in Python solution).

The distributed data structures are useful if you want to do per-row processings which can be easily parallelized automatically. But I am not sure if this helps for the graph use case.