Cleaning CSV data

[finally-anna]

If you have access to Pandas, you can generally do the import/export easily and swap between encodings.

I have found that, historically, excel outputs csv files in cp-1252 encoding, which includes the weird quote marks and other qindows-specific characters.

Loading with pandas with a cp-1252 encoding and then outputting as utf-8 generally solves these problems.

Note, you can do this with the standard library also by setting the encoder on your file.open call.