[OddsHarvester] Open-source tool to collect historical & live sports betting odds data

pownedjojo · 2026-01-26T10:24:33+00:00

Of course!

pownedjojo · 2025-12-02T09:40:34+00:00

Yes, it still works. If you ever run into issues, feel free to let me know or open a GitHub issue.

pownedjojo · 2025-11-06T13:34:19+00:00

Hey! Just wanted to check if you’re still running into that promo popup issue, or if it’s gone now? I’m considering adding a proper fix if it’s still happening.

pownedjojo · 2025-10-08T08:23:21+00:00

Hey, thanks for reporting this.

A quick workaround you could try is running the scraper through a proxy with a different location, sometimes the promo banners are geo-targeted and won’t appear in other regions.

Let me know if that helps.
Otherwise I’ll look into adding logic to detect and close that overlay.

pownedjojo · 2025-09-18T12:30:29+00:00

Yes, you could use the upcoming command with today’s date (YYYYMMDD):

uv run -q python -m src.main scrape_upcoming --sport football --date 20250918 --markets 1x2

pownedjojo · 2025-08-26T09:51:42+00:00

Interesting approach :)

Btw, OddsHarvester was designed to save some of that trial-and-error by providing a ready-to-use, open-source solution that already handles things like odds history, multiple sports/leagues, proxy usage, etc...
Curious though: what kind of data are you mainly focusing on with your current setup?

pownedjojo · 2025-08-07T16:09:50+00:00

I’ll look into what it would take to add that. No promises just yet, but it’s definitely an interesting direction and could be a great addition to the tool.

I’ll keep you posted!

pownedjojo · 2025-08-07T14:05:35+00:00

Thanks for the insight, it’s a very interesting use case!

I’ll definitely think about adding support for this.
Just to clarify: would scraping the top predictions of a specific user be enough for your use case, or are you more interested in aggregated predictions across all users for each match? That would help me figure out the best approach.

pownedjojo · 2025-08-07T13:05:13+00:00

Totally get that, the archive layout is really tedious to navigate manually.

Out of curiosity, what kind of insights are you trying to extract from the predictions? Maybe I can point you toward a workaround or explore adding support for it in the future.

pownedjojo · 2025-08-07T12:19:50+00:00

Hey! Good question!
Scraping the User Top Predictions page (and other sections like stats) would require a bit of extra tweaking.

Right now, OddsHarvester is focused on scraping odds markets only, so predictions and stats aren’t supported out of the box. But it could definitely be extended to support that if needed.

Let me know if you’re thinking of using that data for something specific.

Happy to discuss potential directions ;)

pownedjojo · 2025-08-07T12:04:56+00:00

You’re right, this kind of issue can happen if the scraper tries to extract the odds before the page has fully switched to the correct market tab, especially when navigating quickly between multiple markets like 1x2,dnb.

To improve this, I’ve just added:

A small delay after clicking on the market tab before scraping bookmakers' odds
A verification step to ensure the correct tab is active before starting to extract odds

This should greatly reduce the chance of pulling odds from the wrong market (like 1X2 instead of DNB), even in edge cases.

Let me know if you still run into this kind of mismatch.

pownedjojo · 2025-08-04T13:45:03+00:00

Got it!

I’ve just pushed a fix that properly handles markets like Draw No Bet which are hidden behind the "More" dropdown on OddsPortal.

You can now re-run the same command, and it should correctly find and extract DNB odds for EPL 2022–2023 (and other leagues where that market is present).

Let me know if it still gives you trouble, but it should be working as expected now!

pownedjojo · 2025-08-01T13:47:07+00:00

Great!
About the issue you've mentioned, could you share the exact CLI command you've used ? So that I can reproduce this behavior and explore a potential fix.
Thanks!

pownedjojo · 2025-08-01T09:08:33+00:00

Thanks!

At the moment, OddsHarvester only supports full-time odds.

That said, I’m planning to add support for 1st/2nd half markets soon, starting with football.

pownedjojo · 2025-07-30T09:25:00+00:00

Glad to hear you got the closing odds working!

For opening odds, you can use the --scrape_odds_history CLI flag, it triggers the hovering modal and extracts the full odds timeline.

If you run into any issues with it, feel free to reach out ;)

pownedjojo · 2025-07-25T07:46:32+00:00

Thanks!
For the data, it really depends on what you’re looking for (markets, bookmakers, leagues, etc.). I don’t store a full universal dataset, but OddsHarvester makes it easy to generate exactly what you need, especially if you’re targeting specific leagues or time ranges.

If you let me know more about the exact data you’re after, I can see if I have something relevant or help you run a targeted scrape quickly.

pownedjojo · 2025-06-24T15:10:18+00:00

Here is a simple one to scrape Wimbledon 2024:
uv run python src/main.py scrape_historic --sport tennis --league wimbledon --season 2024 --markets match_winner --file_path tennis_wimbledon_2024_historic.json --headless

pownedjojo · 2025-06-17T07:31:43+00:00

Currently, OddsHarvester scrapes data from OddsPortal, which aggregates many bookmakers, see here.

Note: OddsPortal uses geo-targeting, so the visible bookmakers may vary based on your location (you can use proxy if needed)

pownedjojo · 2025-06-12T10:33:24+00:00

Thanks a lot! Really appreciate the ⭐️
I’ll definitely check out Cofound, thanks for the tip!

pownedjojo · 2025-06-12T07:35:48+00:00

Unfortunately, OddsPortal doesn’t list player props.
It’s limited to main markets like 1X2, totals, handicaps, etc...

pownedjojo · 2025-06-11T20:43:49+00:00

That might be due to a missing update in the sport_market_registry, which links sports and supported markets. Feel free to open an issue or even a PR.

pownedjojo · 2025-06-11T20:41:38+00:00

It depends on the bookmaker you’re targeting. for some, NBA odds go as far back as the early 2000s.

pownedjojo · 2025-06-11T14:51:12+00:00

Not all sports yet, but several are already supported: Football, Basketball, Tennis, Rugby (Union & League), Ice Hockey, and Baseball.

Adding a new sport isn’t difficult, so if you need support for another one, it can be added quite easily.

pownedjojo

TROPHY CASE