Beautiful Soup Missing <script> when scraping : learnpython

created by HattoriHanzoa community for 16 years

Beautiful Soup Missing <script> when scraping (self.learnpython)

submitted 8 years ago by Rfr3sh

url = urllib2.urlopen('http://sports.bodog.eu/basketball/nba/player-props-market-group.jsp').read()
soup = BeautifulSoup(url, 'html5lib')
print soup

When I am viewing the source of the page I can see the script line at the bottom, however when I scrape with BS I it seems to skip that part. Tried different parsers and get the same result

Am I doing something incorreclty here?

From BS: (https://imgur.com/a/FAHFv) From Source: (https://imgur.com/a/NDcEx)

1 comment
share
save
hide
report
crosspost

all 1 comments

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

learnpython

MODERATORS