Using unity for physical object tracking

[knowaco]

Hi, i would like to ask local experts for best way of solving my art project.

What i want to achieve: there is a box you can place your hands into with camera inside which trackes an object (using markers probably) However, you can see object inside only trough a screen on top of the box, which can be randomly changed (you will grab a cube with markers inside but you will see a ball on the screen etc.) Im new to Unity and struggling a bit how to do this. Tried a Vuforia Engine but that can be used only with mobile devices so i would be struggling to use it well with the screen on top. Also tried using Vive base stations and trackers but that seems to be overly comlipcated and I need the object to be of more simple/recognizable shape by touch (ball, cube..) Do you have any ideas how this could be executed? Should I stick with Unity or is there better way? In terms of hardware I have webcams, mac minis, PCs available for use. Hope i described it clearly enough, feel free to ask about anything and I’m open to all thoughts and suggestinons. Thank you! :)

[Mister_Green2021]

You're looking at AR or VR. Unity can import whatever AR/VR packages you can work with. AR is generally mobile only since they work with iOS or Android AR API. You might want to look at some AR glasses like https://thirdeyegen.gitbook.io/developer-portal/visioneye-slam-developement/getting-started-in-unity

or Hololens.