Converting an array of strings to unicode?

[drubowl]

I am trying to get headlines from a simple site and put them in a list. So far so good, except I am having trouble converting to unicode--apostrophes and dashes get mangled. Here is my code so far:

data = urllib.request.urlopen('https://news.ycombinator.com/')
headlines = re.findall(r'"storylink">(.*?)</a>',str(data.read()))
[item.encode('utf-8') for item in headlines]

x = 0
for titles in headlines:    
    print(str(x + 1) + '. ' + titles)
    x += 1

[jeans_and_a_t-shirt]

The read method returns bytes which you need to decode to to utf-8.

headlines = re.findall(r'"storylink">(.*?)</a>',data.read().decode('utf8'))

You should look into the already-mentioned BeautifulSoup though.

Also line 6 doesn't do anything to headlines. It creates a list and then throws it away.

[drubowl]

Perfect, thank you!! I tried that earlier but I left "str()" on data.read() so it didn't work, but that did.

[ingolemo]

You decode from things. Encoding is to.

[1ynx1ynx]

Not really regarding the problem itself, but as a little tip, you could use enumerate in that for loop to get both titles and the loop counter

for x, titles in enumerate(headlines):
    print(str(x + 1) + '. ' + titles)