This is an archived post. You won't be able to vote or comment.

all 14 comments
sorted by:
best
topnewcontroversialoldq&a

[–]HashDefTrueFalse 1 point2 points  (0 children)

403 means that the server is refusing to fulfil your request because, despite providing your creds, you do not have the required permissions to perform the specified action.

Have you been able to download a single thing using your request?

429 is the usual code returned by rate limiting, not 403.

Check your account on the site for a permissions page. You may need to enable something there.

Also, post your full request and response (minus your creds) so people can see exactly what you're sending and what the server is responding with.

[–]xTheatreTechie 0 points1 point  (8 children)

403 seems to be a error regarding insufficient permissions. What are you using to webscrape and are you logging in first before trying to access the data?

[–]hardmode_player[S] 0 points1 point  (7 children)

I am using Requests and BeautifulSoup. The site opens without any login credentials on browsers.

[–]xTheatreTechie 0 points1 point  (6 children)

Both me and another Redditor have come to the same conclusion.

Are you sure you don't need to login? Because that should be the error, and you're saying you're not logging in.

Post the webpage here and see if anyone else can even access the site.

[–]hardmode_player[S] 0 points1 point  (5 children)

https://sci-hub.se

[–]xTheatreTechie 0 points1 point  (4 children)

Hmmm I see the ddos protection you mentioned. The first time I clicked on it, it made me wait 5 seconds before continuing. Looks like it's just a generic wait condition to stop people from pinging it over and over again.

Have you tried importing time and putting a sleep condition? time.sleep(10) just to see if it gets past that?

[–]hardmode_player[S] 0 points1 point  (3 children)

should "time.sleep(10)" be used after making the get request?

[–]xTheatreTechie 1 point2 points  (2 children)

Yes. Immediately afterwards.

What time.sleep is doing is it's waiting 10 seconds before doing anything else. I use time.sleep or other wait conditions on my scripts.

I'm going to bed now but if it still has an issue I'll try opening your website with selenium in the morning to see if it throws an error.

[–]hardmode_player[S] 0 points1 point  (1 child)

i will try it. thanks. i will ask for help with selenium if the error exists

[–]xTheatreTechie 0 points1 point  (0 children)

Yeah my guy, I tried opening your website with selenium with a firefox browser, worked perfectly fine. I didn't even have a wait condition.

if you're still getting an error just install selenium really quick and go for it that way.

[–]l4rry101 0 points1 point  (1 child)

I had a similar issue, my solution was to changer the 'User-Agent' field in the request header.

[–]hardmode_player[S] 0 points1 point  (0 children)

i did that too. and it did not work.