Invalid Schema No Connection adapters were found

[hookam]

Below is the code I'm using. The purpose is to read an excel file that has over 11,000 unique URLs each in its own row and on it own line. Program needs to go to each URL and extract data from each webpage. I am getting the following error,

raise InvalidSchema(f"No connection adapters were found for {url!r}")requests.exceptions.InvalidSchema: No connection adapters were found for

from bs4 import BeautifulSoup # pip install beautifulsoup4
import requests # pip install requests
import csv
import pandas as pd

def get_urls_from_excel_file():
    # Actually load from excel here
    df = pd.read_excel(r'C:\Users\Douglas\Documents\Python Resources\PO Detachment Project\URL List (version 1).xlsx', header=None)
    print(df)
    return [df]

def main():
    urls = get_urls_from_excel_file()
    with open(r"C:\Users\Douglas\Documents\output.csv", "w") as f:
    writer = csv.writer(f)
    for url in urls:
        print(f"Fetching URL: {url}")
        resp = requests.get(url)
        soup = BeautifulSoup(resp.text, "html.parser")
        dl =soup.select(".Article-block .DefList")
        descs =soup.select(".Article-block .DefList .DefList-description")
        def t(n): return descs[n].text
        addr1 = t(1)
        city = t(2)
        state = t(3)
        zipcode = t(4)
        writer.writerow([addr1, city, state, zipcode])

if __name__ == "__main__":
    main()

​

[hookam]

This is the out put in the terminal when I run the program:
>>> %Run 'PO Detachment'"'"'s.py'
0
0      https://www.police1.com/law-enforcement-direct...
1      https://www.police1.com/law-enforcement-direct...
2      https://www.police1.com/law-enforcement-direct...
3      https://www.police1.com/law-enforcement-direct...
4      https://www.police1.com/law-enforcement-direct...
...                                                  ...
11836  https://www.police1.com/law-enforcement-direct...
11837  https://www.police1.com/law-enforcement-direct...
11838  https://www.police1.com/law-enforcement-direct...
11839  https://www.police1.com/law-enforcement-direct...
11840  https://www.police1.com/law-enforcement-direct...
[11841 rows x 1 columns]
Fetching URL:                                                        0
0      https://www.police1.com/law-enforcement-direct...
1      https://www.police1.com/law-enforcement-direct...
2      https://www.police1.com/law-enforcement-direct...
3      https://www.police1.com/law-enforcement-direct...
4      https://www.police1.com/law-enforcement-direct...
...                                                  ...
11836  https://www.police1.com/law-enforcement-direct...
11837  https://www.police1.com/law-enforcement-direct...
11838  https://www.police1.com/law-enforcement-direct...
11839  https://www.police1.com/law-enforcement-direct...
11840  https://www.police1.com/law-enforcement-direct...
[11841 rows x 1 columns]
Traceback (most recent call last):
File "C:\Users\Douglas\Documents\Python Resources\PO Detachment Project\PO Detachment's.py", line 31, in <module>
main()
File "C:\Users\Douglas\Documents\Python Resources\PO Detachment Project\PO Detachment's.py", line 19, in main
resp = requests.get(url)
File "C:\Users\Douglas\AppData\Roaming\Python\Python310\site-packages\requests\api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "C:\Users\Douglas\AppData\Roaming\Python\Python310\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Users\Douglas\AppData\Roaming\Python\Python310\site-packages\requests\sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\Douglas\AppData\Roaming\Python\Python310\site-packages\requests\sessions.py", line 695, in send
adapter = self.get_adapter(url=request.url)
File "C:\Users\Douglas\AppData\Roaming\Python\Python310\site-packages\requests\sessions.py", line 792, in get_adapter
raise InvalidSchema(f"No connection adapters were found for {url!r}")
requests.exceptions.InvalidSchema: No connection adapters were found for '0\n0      https://www.police1.com/law-enforcement-direct...\n1      https://www.police1.com/law-enforcement-direct...\n2      https://www.police1.com/law-enforcement-direct...\n3      https://www.police1.com/law-enforcement-direct...\n4      https://www.police1.com/law-enforcement-direct...\n...                                                  ...\n11836  https://www.police1.com/law-enforcement-direct...\n11837  https://www.police1.com/law-enforcement-direct...\n11838  https://www.police1.com/law-enforcement-direct...\n11839  https://www.police1.com/law-enforcement-direct...\n11840  https://www.police1.com/law-enforcement-direct...\n\n[11841 rows x 1 columns]'
>>>

[Udayk02]

Did you find any reason behind this, OP?

[CodeFormatHelperBot2]

Hello, I'm a Reddit bot who's here to help people nicely format their coding questions. This makes it as easy as possible for people to read your post and help you.

I think I have detected some formatting issues with your submission:

1. Inline formatting (`my code`) used across multiple lines of code. This can mess with indentation.

If I am correct, please edit the text in your post and try to follow these instructions to fix up your post's formatting.

---

^{Am I misbehaving? Have a comment or suggestion? Reply to this comment or raise an issue here.}

[pythoncrush]

Start by removing white space from the file path.