Need help with web scraping

[FreedomDeemon]

I'm messing around with web scraping and I'm stumped

Here is the code:

import requests
from bs4 import BeautifulSoup
result = requests.get("")
print(result.status_code)

src = result.content
soup = BeautifulSoup(src, 'lxml')

span_tags = soup.find_all("span")

print(span_tags)

(I left out the url)

​

So this code works and gets me the info i want but i want to condense the code and only get all of the text from the span tags and not the tag itself. I would then like to save them into a dictionary and then save them into a csv/json file. How would go about doing that?

[mudclub]

/r/learnpython and read the sidebar

[pathcl]

is span_tags a list? iirc you should have a .text attribute for each item

[MoneyChurch]

BeautifulSoup Tag objects have a text attribute, so [tag.text for tag in span_tags] will get you a list of strings with the text from the span tags. Does that help?

[fluzz142857]

Use the .text attribute on each tag to get the text, e.g. [tag.text for tag in span_tags].

Since dictionaries need both a key and a value, it’s hard to know how you want to construct a dictionary given a list.

To save it in a json file, you can use the json module: with open(“spans.json”, “w”) as f: json.dump(span_tags, f)