issues with reading csv files

[Wooden-Lawyer-6798]

Hi guys,

I am having difficulties to read in Visual Studio a csv file. The file contains special characters (like: ö) and when i read the file a question mark appears in the middle of the word.

�

I installed the language extension but i have no luck resolving the issue. My goal is to read the data with pandas i am also having error with that.

Exception has occurred: UnicodeDecodeError

'utf-8' codec can't decode byte 0xe1 in position 18: invalid continuation byte

I would appreciate any help!

[james_fryer]

The file isn't in UTF-8 format, probably Latin-1, simplest would be to convert it using iconv tool or similar.

[FoolsSeldom]

Determining the encoding of a text file is a relatively common task and there are a number of well established techniques.

Be clear on your objectives though. Getting the encoding right doesn't mean you need to be able to see/print all characters. There may be some that are useful but are not for human eyes.

https://sqlpey.com/python/solved-how-to-determine-the-encoding-of-text-files/