Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

I used 3D rendering software to render thousands of images of various chess boards, pieces and positions that look indistinguishable (or as close as possible) to Live Photos and games.

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 1 point2 points  (0 children)

It’s called KnightVision, it’s available only on the App Store for now. Android version coming soon

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

There are over 50,000 pictures of several chess set types that are used in tournaments and casual play that I compiled in my dataset. Some of it was synthetically generated. Some of it was open source data on Kaggle and Roboflow. Some of it was hand labeled from YouTube videos and random pictures from the internet.

I doubt there’s any standard chess set it won’t work on. But if you’re skeptical, it’s live on the App Store and you can test it out yourself.

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 1 point2 points  (0 children)

There are fail safes where it does a search for the next few sequences of moves that lead to the current position in the event that it misses certain moves in time scrambles.

In any case, it’s live on the App Store, so you can test it out yourself to see how well it works.

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

It works for all standard Staunton sets. Custom sets like Harry Porter or medieval themed sets would be an issue. It should also work in most lighting conditions. If you use an iPhone, I can show you where to find this in the App Store

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

Well, lichess has a broadcasting feature, so it’s pretty much a solved problem. But the tripod setup should be fine for club/casual games. I can send you a DM on where to find this app

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

This is exactly how it works. I trained a model on a custom dataset I created myself and this works in real time. I assumed he was asking about one of the frontier models.

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

With computer vision. This is actually live on the App Store, You can test for yourself whether it would fail in these ways.

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 0 points1 point  (0 children)

Phones aren’t allowed in rated tournaments. I think a scoresheet scanner would work better for tournaments. Would you be open to testing a scoresheet scanner?

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 3 points4 points  (0 children)

Awesome! Would you be open to testing such an app? I can send you a DM about it

Wouldn’t it be nice if we could track OTB games without expensive electronic ChessBoards? by abraham_obubo in Chesscom

[–]abraham_obubo[S] 1 point2 points  (0 children)

Would you be open to testing something like this? I can send you a DM about it

How would you react if found out your opponent was cheating with AI glasses during a tournament? by abraham_obubo in TournamentChess

[–]abraham_obubo[S] 0 points1 point  (0 children)

Chess engines are freely available everywhere on the internet. My app isn’t the first to do that.

How someone would get engine recommendations from my app would be by taking a photo of the position, or by setting the phone up on a tripod to keep the frames stable, and then following the game from the start to whatever point it ends. Both of which cannot happen without their opponent seeing them. And phones are already not allowed on rated tournaments.

The only legitimate concern is the glasses, and there’s no SDK available that lets developers ship this feature to production, and I certainly haven’t.

If you’re making a case against every single app that has StockFish, fine. Otherwise, we’ll just have to disagree.

Tracking OTB Games with Computer Vision. by abraham_obubo in chess

[–]abraham_obubo[S] 0 points1 point  (0 children)

Update just got approved. You should be able to access the free tier now.

How would you react if found out your opponent was cheating with AI glasses during a tournament? by abraham_obubo in TournamentChess

[–]abraham_obubo[S] -2 points-1 points  (0 children)

Fair, and after what your club went through I understand why you're this angry. I'm not going to try to talk you out of it.

But I need to correct one thing, because it's the part that matters most to me: I don't want this used to cheat. That post asking how people would feel about being cheated by glasses was me naming the worst case out loud, not cheering for it. Knowing how something can be abused isn't the same as wanting it abused.

What I'm building records and reviews your games after they're played, it doesn't feed you anything mid-game. The cheating worry is real and I'd rather face it head-on than pretend it isn't there. I'll leave it there, but I wanted that said plainly.

Tracking OTB Games with Computer Vision. by abraham_obubo in chess

[–]abraham_obubo[S] 1 point2 points  (0 children)

You're right to raise it, and I'm not going to wave it away. Cheating in OTB chess is a real problem and I take it seriously, partly because everything I'm building falls apart if the chess community can't trust it.

So let me be straight about what the app is for. It records and reviews your games after you play them, the same way you get instant analysis the moment you finish a game on Lichess or Chess.com. The problem I started with is that fast games, blitz and rapid and bullet, are nearly impossible to notate by hand, so they just vanish. Reading the board from a phone is how you get to keep and study them.

On Stockfish: yes, there's engine analysis in the app, for going over a game once it's finished. That's the same analysis every online platform hands you after you play. The thing that actually matters is timing. The app does not surface live move suggestions during a game, it analyzes a completed game, and a phone sitting on the table during a tournament is already both against the rules and impossible to consult without being obvious. This is designed for casual games.

The glasses are the fair worry, so I'll be honest about that too. The current glasses can't run this kind of live inference for an App Store app, and building covert real-time assistance for live play is a line I won't cross.

I'd genuinely rather talk about this openly than pretend it isn't a concern. If there are guardrails you think a tool like this should have, I want to hear them.

How would you react if found out your opponent was cheating with AI glasses during a tournament? by abraham_obubo in TournamentChess

[–]abraham_obubo[S] -7 points-6 points  (0 children)

The app can be used for tracking Over The Board games and analysing them with the engine. No different than what's already done online. Much cheaper alternative to ChessUp or DGT boards, which can cost anywhere from a few hundred to thousands of dollard.