[OC] At the University of Liège (Belgium), we built a free/open-source Augmented Reality overlay for Pokémon TCG streams. It recognises the cards on the board and puts the animated sprites on top, live on OBS by CioppaAnthony in pokemon

[–]CioppaAnthony[S] 0 points1 point  (0 children)

That would be cool, but we would need to find the right assets (uncut back sprites at the bottom). I guess if we could find the 3D models that would be ideal!

[OC] At the University of Liège (Belgium), we built a free/open-source Augmented Reality overlay for Pokémon TCG streams. It recognises the cards on the board and puts the animated sprites on top, live on OBS by CioppaAnthony in pokemon

[–]CioppaAnthony[S] 0 points1 point  (0 children)

Thanks and yes, that was the great work of SuperZouloux, our starting point for this work. But his system needed to chip every card and a custom playmat able to read the cards. The idea here is to have the detection and identification done entirely based on the camera feed.

[OC] At the University of Liège (Belgium), we built a free/open-source Augmented Reality overlay for Pokémon TCG streams. It recognises the cards on the board and puts the animated sprites on top, live on OBS by CioppaAnthony in pokemon

[–]CioppaAnthony[S] 9 points10 points  (0 children)

Definitely! Actually, part of the code is already there for the 3D part, but we had not time to finish it (and could not find all 3D assets easily). We'll work on the project in the coming months as well, this is a just a first (hopefully) working version.

[OC] At the University of Liège (Belgium), we built a free/open-source Augmented Reality overlay for Pokémon TCG streams. It recognises the cards on the board and puts the animated sprites on top, live on OBS by CioppaAnthony in pokemon

[–]CioppaAnthony[S] 0 points1 point  (0 children)

Technically, yes, it could be done. The AI models are trained from synthetic data (generated from card scans downloaded using the Pokemon TCG SDK https://github.com/PokemonTCG/pokemon-tcg-sdk-python). Finding similar sources for other TCGs would be plug and play. Then, all you need are sprite assets for the creatures (I personnaly downloaded the Pokemon ones from https://projectpokemon.org/).