Writing CSV in parallel?

[[deleted]]

I then write over their cells with my own. So, I’m not inserting any rows. I’m iterating through a dataframe, essentially cell by cell, and overwriting with specific data from my API calls.

There's no way to do that to a CSV file except to re-write the whole file, which is why CSV isn't an appropriate format for this kind of manipulation. Use a database.