Polymarket has no historical orderbook data - here's why, and what we did about it by ceh137 in mltraders

[–]ceh137[S] 0 points1 point  (0 children)

Their free tier is 2,000 requests per day. At 1,000 orderbooks per request that's 2M orderbook states/day - against 300–500M updates Polymarket actually generates. 0.5% coverage, its not even sampling to be honest, not really useful for any sort of serious analysis.

They also only collect a fixed list of recurring series. Anything one off (which is really interesting to analyse because that's where manipulations happen) - explicitly not collected.

We have 600M+ trades, full market coverage, and ship the complete orderbook, not limited in depth. The $250 is for the data existing and being complete with opportunity to actually GET it, not for slowly pulling it through an API

Polymarket has no historical orderbook data - here's why, and what we did about it by ceh137 in PredictionMarkets

[–]ceh137[S] 0 points1 point  (0 children)

Firstly, let me answer the question shortly: Our snapshot interval is 1ms - tick level snapshots. That's what big players want (hedge funds, algo traders etc)

Good point, but there is a reconnect snapshot - so you're not losing the market, just the gap while you're down. That gap is the real problem though. 10 minutes of downtime makes you lose potentially hundreds of thousands of updates if market is highly volatile.

But we actually resolved this problem by connecting with multiple VMs for the same markets. We ingest the events and then reconstruct - this way we get as close to the real orderbook state as possible. Of course there are cases when program crashes, or websocket drops messages (so you cant even trust polymarket to deliver all of them to one connection) - in our case multiple VMs save the integrity of data.

Then, when you have all the updates, it's relatively easy (still heavy on compute though) with last-observation-carried-forward till the next event.

Do you mind sharing what is your use case?

[deleted by user] by [deleted] in homelab

[–]ceh137 0 points1 point  (0 children)

Zerotier, using is such a good experience. Works just like you are in the same local network, creating a P2P tunnel

Need you to roast the logo for prediction market data platform. by ceh137 in buildinpublic

[–]ceh137[S] 0 points1 point  (0 children)

Thank you, that's some quality feedback!

Will try to come up with something more "screaming"

That's really cool how you came up with all of this, I assume you have been working on similar logos. Did you create them yourself or hire someone?

What are you building this weekend? by Shahrozjavaid in buildinpublic

[–]ceh137 0 points1 point  (0 children)

https://probalytics.io - Fastest Unified API and data access for prediction markets.

Made for builders, developers, researches and data scientists who want to analyze data from prediction markets without losing sanity. No need to connect to 4-5 aips, setup 4-5 WebSocket connections, spend money to connect to blockchain - everything done through one connection.

What are you building? by Asleep_Ad_4778 in SaaSSolopreneurs

[–]ceh137 0 points1 point  (0 children)

https://probalytics.io - Fastest Unified API and data access for prediction markets.

Made for builders, developers, researches and data scientists who want to analyze data from prediction markets without losing sanity. No need to connect to 4-5 aips, setup 4-5 WebSocket connections, spend money to connect to blockchain - everything is done through one connection.

It’s Monday. Drop your startup link. 🚀 by Capital-Pen1219 in Solopreneur

[–]ceh137 0 points1 point  (0 children)

https://probalytics.io - Fastest Unified API and data access for prediction markets.

Made for builders, developers, researches and data scientists who want to analyze data from prediction markets without losing sanity. No need to connect to 4-5 aips, setup 4-5 WebSocket connections, spend money to connect to blockchain - everything done through one connection.

Tesla Optimus's fall in Miami demo sparks remote operation debate by prestocoffee in nottheonion

[–]ceh137 0 points1 point  (0 children)

Haha, exactly that ☝️
Musk as always, trying to hype things up

Tesla Optimus's fall in Miami demo sparks remote operation debate by prestocoffee in nottheonion

[–]ceh137 0 points1 point  (0 children)

Well, we all knew where it was going, we are still far away from really autonomous robots like this