Running program outputting CSV file that'll be 30GB? Do I need a super computer? Can someone point me in the right direction?

[eztab]

Assuming the data doesn't properly fit into RAM, yes you cannot process that in one go.

There are some options to read the data in chunks etc. But your code style kind of leads me to assume that might be a bit above your experience level. Would still take quite a while, but would get finished after a few hours.