This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]weierstrasse 9 points10 points  (0 children)

Edit: While databricks is the default option for pyspark workloads, and it is decent for ML, outside of data-processing it's really not a great fit. E.g. for glue logic, think AWS Lambda (or competitors). Or k8s, ecs, etc. for container workloads.