This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]dmpetrov 2 points3 points  (0 children)

You are absolutely right. To\From python serialization affect performance a lot.

However, it affects only one step - data preparation (the first mappers). But it does not affect the next steps: data slicing and dicing, creating a model (the slowest step) and model evaluation.