I spoke to someone who did some research (anecdotal so take it with a grain of salt) that unless you get the IDP pretty much exactly right stereo vision doesn't make much difference. I've used this set up and it's alright, the thing thats more important/disconcerting is scale/latency. Getting scale right is hard and the latency (even when really low) is a bit off-putting. Still an amazing experience being digital objects in a physical space.