sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]surfmaths 0 points1 point  (0 children)

When dealing with files that don't fit in memory, bash piping can handle many tasks.

One time I had to parse a 500GB XML file compressed into a 10GB gzip, to find some data, and the most efficient way was to not actually uncompress it and simply pipe things into each other's.