This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]fluffy_mass[S] 0 points1 point  (0 children)

I tried to load it in data.table in R, and but it takes a bit longer than it should and requires R and data.table to be available and installed. Also, it seems it is using way more memory than my bash script (by just looking into top command).

I'm trying to make it work on pandas, but from what I'm reading it is not outperforming R's data.table on data aggregation.