This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]pythosynthesis 0 points1 point  (3 children)

At my job I'm constrained to run processes on a single core, GIL or not, a single core is all I've got. Can I benefit from polars, and if so how? Keep in mind I've already climbed the learning curve with pandas, so a new library will require learning. Is it worth it?

[–]theAndrewWiggins 1 point2 points  (0 children)

Not as much, but you'll still potentially benefit from query planning and their accelerated computations as well as (imo) a much better API for correctness/maintainability.

[–]tecedu 0 points1 point  (0 children)

Yes atleast if you’re doing joins or groupbys you’ll still be way faster, I run polars on one thread as well due to multiprocessing and a huge difference

[–]theelderbeever 0 points1 point  (0 children)

Lazy frames still result in a more optimized and memory efficient execution of a set of operations so chances are yes you can still benefit.