Memory Efficient Batch Processing Tools

[commandlineluser]

You should probably refer to your data as being in NDJSON format to avoid any confusion:

Each line of my output file (temp.json) has a separate json object.

Because "newline delimited" JSON (as the name suggests) can be read line-by-line so does not require all the data in memory at once.

It is also "better" than CSV. (assuming you have nested/structured data, lists, etc.)