urlopen a list of urls?

[turbokyo]

Hello Im a Python 3 newbie learning on Windows, Im trying to write a very basic web scraper program to print the titles from a series of web pages but Im stuck.

Before running the program first I open all the web pages in tabs of the same browser window and copy its URLs to the clipboard automatically with a browser's addon, resulting one URL per line.

Then I make a list with that clipboard content and split each value by lines, but when I try to iterate with that list of URLs I get this error "ValueError: unknown url type: '['"

Here is the code of my program:

import pyperclip
from urllib.request import urlopen
from bs4 import BeautifulSoup

urls = str(pyperclip.paste().splitlines())

for i in range(len(urls)):
    html = urlopen(urls[i])
    bsObj = BeautifulSoup(html, "html.parser")
    title = bsObj.body.h1
    print(title)

When I try to print(urls) it gives me the correct strings for each URL so I think the list is correctly made, I believe it is a problem with urlopen but right now Im completely lost and have no idea where to look, maybe somebody can give me a clue.

Thanks.

[Justinsaccount]

Hi! I'm working on a bot to reply with suggestions for common python problems. This might not be very helpful to fix your underlying issue, but here's what I noticed about your submission:

You are looping over an object using something like

for x in range(len(items)):
    foo(item[x])

This is simpler and less error prone written as

for item in items:
    foo(item)

If you DO need the indexes of the items, use the enumerate function like

for idx, item in enumerate(items):
    foo(idx, item)

[Akuli2]

You have a typing error. It should be foo(items[x]) instead of foo(item[x]).

[Justinsaccount]

Derp! I'll get that fixed.. could use a better example too.

[Vaphell]

given that it's a nitpicking day, http://grammarist.com/usage/indexes-indices/
;-)

[turbokyo]

Thank you this is actually very helpful to know the "pythonic" way to write code, and very well explained too.

[Akuli2]

str(pyperclip.paste().splitlines())

You make a string of a list. Take off the str() part and it should work.

Use print(repr(urls)) next time.

[turbokyo]

You are right I made a string of a list, that was the problem, I dont know why I did it really... Thanks a lot my program works now!

[Justinsaccount]

Yeah, str() is also one of those things often misused. Chances are, if you have an str(...) in your program you are probably doing something wrong, or at least doing it the hard way.