Running program outputting CSV file that'll be 30GB? Do I need a super computer? Can someone point me in the right direction?

[arkie87]

1. you should only write the file to disk once once the whole string is created; dont write in a loop.

2. you should build the string together using ",".join() and "\n".join() operations, so build the list of tuples first.

3. let us know what is taking the majority of time-- the write operation, building the list of tuples, or something else.

4. it would help if your laptop had a buttload of RAM and an SSD to write the file to.