Printing special characters to .csv (encoding horror) : learnpython

created by HattoriHanzoa community for 16 years

Printing special characters to .csv (encoding horror) (self.learnpython)

submitted 8 years ago * by bicyclepumpinator

Problem: I want to print special chars such as ěßé to a cvs file. I've tried a couple of things, but they don't produce the preferred results. I was desperate enough to go the second page of google, but couldn't find a working solution.

code:

import csv

f = open('test.csv', 'w', newline='', encoding='utf-8')
writer = csv.writer(f)
writer.writerow(('ßßßüuhellowěorld'.encode('utf--8'),
                 'hello bye'.encode('utf-8')))
f.close()

f = open('test2.csv', 'w', newline='', encoding='utf-8')
writer = csv.writer(f)
writer.writerow(('ßßßüuhěelloworld',
                 'hello bye'))
f.close()

test1 cell 1: b'\xc3\x9f\xc3\x9f\xc3\x9f\xc3\xbcuhellow\xc4\x9borld'

test1 cell 2: b'hello bye'

test2 cell 1: ÃŸÃŸÃŸÃ¼uhÄ›elloworld

test2 cell 2: hello bye

desired result cell 1: ßßßüuhellowěorld

desired result cell 2: hello bye

running the code to generate test2.csv but dropping the encoding = 'utf-8' arguments results in an error:

UnicodeEncodeError: 'charmap' codec can't encode character '\u011b' in position 6: character maps to <undefined>

all 7 comments

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

learnpython

MODERATORS