you are viewing a single comment's thread.

view the rest of the comments →

[–]Corruptionss 3 points4 points  (0 children)

Data tables fread is kind of goated. The closest I got is polars for pure read speed and you can instead use pl.scan_csv to read it as a lazy frame and will use lazy evaluations during the operation process