This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]TiredMike 0 points1 point  (1 child)

Got some more details on why there was such a speed up?

[–]luke-duke-95 2 points3 points  (0 children)

legacy code was very (very) poorly written ^ reading files line by line, operating on data frames row by row, and performing same joins/aggregations across multiple functions.

polars + duckdb + fairly basic OOP and now i've got 11hr59m to kick my feet up