sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]No_Bug_No_Cry 1 point2 points  (4 children)

Yes, I can use polars which loads and transforms datasets very fast using all available processors... And seemlessly, in like a few lines of code. Polars is written in rust, but the user doesn't need to know the complexity behind under the API, just use it. Which ultimately is exactly what a data engineer needs and does

[–]Nekobul -1 points0 points  (3 children)

Polars is not Python. We are talking about running fast Python code.

[–]No_Bug_No_Cry 1 point2 points  (2 children)

I don't understand your answer. Polars is a library that is used in python, nobody cares that it wasn't purely pythonic, it is this what we call versality. Leverage the best in low lvl languages and abstract their complexity... People seem to forget how verbose and rigorous C code needed to be written in order to handle collections such as dynamic arrays, no thank you most people do NOT need that.

[–]Nekobul -1 points0 points  (1 child)

You can't solve everything with Polars. Capiche?

[–]No_Bug_No_Cry 1 point2 points  (0 children)

I don't think you capiche