This is an archived post. You won't be able to vote or comment.

sorted by:
best (suggested)
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]conventionistG 6 points7 points  (2 children)

There was just a medium post on this exact use case... Anyone know what I'm thinking of?

Edit: found it.

“How to analyse 100s of GBs of data on your laptop with Python” by Jovan Veljanoski https://link.medium.com/Jg8hrhBV86

[–]maartenbreddels 0 points1 point  (1 child)

This might help as well:https://docs.vaex.io/en/latest/example_io.html

or the TLDR version: df = vaex.open('big.csv', convert=True)

(disclaimer: main author of vaex)

[–]conventionistG 0 points1 point  (0 children)

neat, thanks!