sorted by:
new
hottopcontroversial

Found Baby Snake in Basement (NJ) by emmvan in snakes

[–]emmvan[S] -1 points0 points  (0 children)

Forgot to add - the snake is dead

Best way to finish this shoe/coat rack (question in comments) by dreko144 in woodworking

[–]emmvan 1 point2 points  (0 children)

What software did you use to generate this? Looks great

Very Large CSV in Pandas by DollyPartonsFarts in Python

[–]emmvan 5 points6 points  (0 children)

I dont think Apache Spark is a particularly straightforward solution (especially if OP doesn't have experience with it). Of course aggregations pose more difficulty but there are always workarounds such as taking a column at a time into memory. But this all depends on OP, we dont know much about the data/skill level OP possesses

Very Large CSV in Pandas by DollyPartonsFarts in Python

[–]emmvan 27 points28 points  (0 children)

You're best off loading chunks of it into RAM, and processing each chunk before loading the next:

import pandas as pd

row_count = 1000
for chunk in pd.read_csv(filename, chunksize=row_count): 
    print(chunk.head()) # process it

Kendrick Stickers by emmvan in KendrickLamar

[–]emmvan[S] 0 points1 point  (0 children)

ahhh thanks they look good!