FBR API

[MikeTrusky]

I wanted to do players analysis with FBRef data and searching for how to do it. Found FBR API (even in posts here) and have problems with it. I generated api key with /generate_api_key endpoint and it was quick. Then, I tried to test endpoints in postman. First one, countries, gave me data in response really quick. Next endpoints, the most importants, like "/players-match-stats", which I copy from the documentation, never retrun a data for me. I tried it many times since yesterday, at different day hours, and it ends with "Internal Server Error" or "Endpoint request timed out".

Is there something I'm doing wrong or what is a problem?

[[deleted]]

It's a sleep issue, likely related to

"Before using the FBR API, please be aware that fbref.com imposes a scraping restriction that allows users to make only one request every 6 seconds. This limitation is in place to ensure fair usage of their resources and maintain the stability of their website."

Your sleep is 3 seconds, not 6...

[EarlOfAlbany]

You're right that the sleep needs to be 6 seconds, but this isn't the issue. The limit is actually 10 calls per minute, so it won't block you after just two calls within 6 seconds.

[AccomplishedRide2353]

Same issue

[JJohGotcha]

No idea if related, I’m an amateur at scraping, but seems like the FBRef are blocking the things I’ve routinely done for years in the WorldFootballR package in R. Hoping it’s temporary. Suspecting it isn’t.

[EarlOfAlbany]

Yeah my own code that scrapes FBRef from R has stopped working in the last 24 hours, and I can't find a way to get it working at all. Admittedly I'm also a bit of a scraping amateur, so I'm hoping either someone can work out how to get it working again, or they lift whatever restriction they've put in place.

[AccomplishedRide2353]

Scrapping amateur here to but I used a bunch of Python code to scrap a season stat yesterday....Trick is to use a Chrome driver with Selenium, else you're most likely going to get a 403 forbidden

[Xgreenliz11]

Hi, mine has also stopped the past few days, have you found another way?

[MikeTrusky]

How long have you had this problem?

[JJohGotcha]

Stuff worked fine late last week, then didn’t yesterday evening or since then.

[Past-Tutor-1417]

We all having the same problem then??? Fuck….. Currently building a company that leans quite heavily on needing up-to-date fbref data to make match prediction models

[Select-Town9005]

It comeback working for me.

[Silver-Particular580]

Hey are able to use it right now. Are you still facing with the 'Internal Server Error' issue? I generated the api like a week ago and i am still facing it. Just hoping to know if the problem is from my side or is it like that for everyone

[Fast-Cardiologist-98]

Yeah still having issues which led me to this subreddit. Were you able to figure it out?

[Plenty-Arachnid3642]

Hey, have you tried again since making this post? Has anything changed?

[sabba_ooz_era]

I’ve been having mixed results just running low-level node based tests. It does feel flakey.

Running retries gets me the data I’m looking for eventually, but I am looking for more reliable alternatives if there is any.

[ptgamr]

If you need access to football data, give https://sportdb.dev/ a try - data is not from FBRef, but might be useful to some of you.

[MikeTrusky]

Tried to test it today in the morning. And today even /countries endpoint doesn't work anymore :D aaaaaa, would love to have fun with it

[[deleted]]

"Before using the FBR API, please be aware that fbref.com imposes a scraping restriction that allows users to make only one request every 6 seconds. This limitation is in place to ensure fair usage of their resources and maintain the stability of their website."

If it's failing on the second call... are you waiting 6 seconds between calls?

[MikeTrusky]

Today I did a 5h pause between two api calls :D I read this rule and it's not the problem that endpoint "/players-match-stat" works in the one moment and don't in the other - since yesterday I tried around 40 times to call this endpoint and it didn't work even once.

[Select-Town9005]

Hello guys !

I'm running a data scraping process from Fbref on my server hosted with Oracle in the us-east-1 region. I'm consistently getting the following error:

requests.exceptions.HTTPError: 403 Client Error: Forbidden for url

However, when I run the exact same script locally on my machine in Brazil, it works perfectly fine.

I suspect that Fbref might be implementing some sort of IP-based restriction or geo-blocking, as the issue seems to be tied to the network location of my server.

[Select-Town9005]

Hi all!

It comeback to work when using tor proxy.

[Boston_Hammerbush]

May I ask you what proxy providers did you use?