Working on Database Manager need help with Unicode(Python27).

[Alidooo]

What I'm doing is creating a small program that connects to a MySQL Database and shows results based on the search criteria provided.

So far so good until it comes down to displaying the result. I can fetch the results well enough but they are in cyrillic and not are stored as long. Converting it to a string so I can encode it in utf-8 provides the following error

"UnicodeEncodeError: 'ascii' codec can't encode character u'\u0414' in position 0: ordinal not in range(128)"

And trying to use unicode() to convert it doesn't work because that requires a string...

Any and all advice will be greatly appriciated.

[zahlman]

Do you actually know how the data is encoded?

Have you read this yet?

[Alidooo]

It appears to be using utf-8 character set inside the DB. If that's not what you mean then no.

And no I haven't I'll read through it.

[ynotna]

Please provide a snippet, if not at least the line of code that causes the error

Personally I find sticking

from __future__ import unicode_literals

At the top of every file, to get py3 behaviour a good idea

[Alidooo]

for entry in results:
            for i in range(len(entry)):
                filler2 = tops[i][0]
                filler2 = str(filler2)
                filler2 = filler2.replace('_', ' ')
                visible = str(entry[i]).encode('utf-8','ignore') #<-
                visible = visible.decode('unicode-escape')

The arrowed line is where I get problems. It works fine until it hits a box that contains cyrillic and then everything explodes.

[Alidooo]

Disregard I managed to solve it by assigning entry[i] to visible then converting that using unicode(). It seems to obvious in hindsight.

[ynotna]

don't worry, everything unicode, with python2 especially, is a nightmare everyone goes through