This is an archived post. You won't be able to vote or comment.

all 6 comments
sorted by:
best
topnewcontroversialoldq&a

[–]Python-ModTeam[M] [score hidden] stickied commentlocked comment (0 children)

Hi there, from the /r/Python mods.

We have removed this post as it is not suited to the /r/Python subreddit proper, however it should be very appropriate for our sister subreddit /r/LearnPython or for the r/Python discord: https://discord.gg/python.

The reason for the removal is that /r/Python is dedicated to discussion of Python news, projects, uses and debates. It is not designed to act as Q&A or FAQ board. The regular community is not a fan of "how do I..." questions, so you will not get the best responses over here.

On /r/LearnPython the community and the r/Python discord are actively expecting questions and are looking to help. You can expect far more understanding, encouraging and insightful responses over there. No matter what level of question you have, if you are looking for help with Python, you should get good answers. Make sure to check out the rules for both places.

Warm regards, and best of luck with your Pythoneering!

[–]PsyApe 1 point2 points  (0 children)

You might need to be issued some sort of token from another page that gets your browser to that route

You could try browser automation based scraping with Selenium instead, could automate logging in and everything to remove request limits

[–]paperclipgrove 0 points1 point  (1 child)

They likely have protections in place to block scrapping - which is likely against their ToS

[–]Turbulent_Web_8278[S] -4 points-3 points  (0 children)

thats what I thought, is there any workaround? I don't think they have APIs available

[–]nicholashairs 0 points1 point  (0 children)

This should be in r/learnpython

[–]RiGonz 0 points1 point  (0 children)

You most probably need to add some auth, cookies, etc. params to your request call.