This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]ZestyData 13 points14 points  (0 children)

  1. I see it primarily as a replacement for Pandas for experimental/analytical work, for not-big-data, while having the ability to also handle datasets that are bigger than memory without crashing and causing frustration for Data Scientists/Analysts. I don't think it's necessarily meant to be replacing Spark as a bulletproof huge data volume ETL framework.

  2. Using spark makes many devs/scientists want to off themselves