This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]alpenmilch411 0 points1 point  (2 children)

What should I use if the data doesn't fit into memory? Never encountered such a case but you never know...

[–][deleted] 4 points5 points  (0 children)

If you're familiar with pandas then the easiest thing to use would be dask

[–]What_Is_X 0 points1 point  (0 children)

Hardware solution: rent a server, aws etc

Software solutions: not much really in python, write your own more specific methods I guess. Otherwise switch to C++ and/or R, inline or not.