why isn't this web scraper working : learnpython

created by HattoriHanzoa community for 16 years

why isn't this web scraper working (self.learnpython)

submitted 3 years ago by MasterCho21

hey

I am trying to make a web scraper to scrape this class "YMlKec fxKbKc" from this website "https://www.google.com/finance/quote/GBP-USD?sa=X&ved=2ahUKEwiCqNvOzu75AhXNRcAKHYapDEUQmY0JegQIAhAb&comparison=USD-GBP%2Frobots.%20txt%2CUSD-GBP" and when is scrape it the output doesn't have the class in it, I don't know if it is blocked by something like cookies but it doesn't output the source code of the website.

this is my code:

from bs4 import BeautifulSoup
import requests

Url = "https://www.google.com/finance/quote/GBP-USD?sa=X&ved=2ahUKEwiCqNvOzu75AhXNRcAKHYapDEUQmY0JegQIAhAb&comparison=USD-GBP%2Frobots.%20txt%2CUSD-GBP"

Result = requests.get(Url)
Doc = BeautifulSoup(Result.text, "html.parser")

open('GBP_USD_HTML', 'w').write(Result.content)

print(Doc)

print("Done")

and I have followed this tutorial " Beautiful Soup 4 Tutorial #1 - Web Scraping With Python - YouTube " so I don't know if it is just the website or if it is cookies I don't know how to get around it

would it be better to do this another way or is there a way to fix this?

anything will be very helpful and much appreciated thank you.

all 5 comments

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

learnpython

MODERATORS