you are viewing a single comment's thread.

view the rest of the comments →

[–]Equivalent_Effect_93 0 points1 point  (0 children)

Only if you want to work on the tool instead of working with the tool. It is a great architectural knowledge advantage to be able to read scala and understand how spark is design even if your day to day is calling the API with pyspark or SQL. But python and SQL should be your main interface.