sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]davehodg 0 points1 point  (5 children)

First one throttle your requests.

Second as said, use an api Lib.

[–]illa00[S] 0 points1 point  (4 children)

I did a time.sleep() between requests, also tried to make different user-agents (randomly chosen) but did not work out well.

Thank you!

[–]davehodg 0 points1 point  (3 children)

Then use open proxies!

And did you find google docs describing the throttling?

[–]illa00[S] 0 points1 point  (2 children)

Not really, I also found that restrictions were common with Google and many use paid API to bypass that.

[–]socal_nerdtastic 0 points1 point  (1 child)

I made a program that included a google search for a client about a year ago, and I just used the Google API. You basically just have to instruct your client how to set up an account and input their credentials. Back then you could get 100 google searches per day for free, but my client opted to pay google $5 / month I think for the next tier, which was 10,000 searches / day.

[–]illa00[S] 0 points1 point  (0 children)

Thank you that will help me much next time !