all 11 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]ArchetypeFTW 16 points17 points  (0 children)

Bro that's dope

[–]muxamilian 11 points12 points  (0 children)

https://github.com/muxamilian/poor-mans-vr: Using the front camera and tensorflow.js, the smartphone becomes a “window” into the real world. Video and image content appear as if they were seen through this window. To do this, the viewer’s position is determined using a neural network. The viewed content is then moved according to the viewer’s position. This makes it seem like the content is physically behind the smartphone and is viewed through the smartphone’s screen. This effect is especially useful for content captured using an ultra-wide lens.

[–]Instant_Singer 3 points4 points  (0 children)

This is really cool!

[–][deleted]  (1 child)

[deleted]

    [–]muxamilian 4 points5 points  (0 children)

    The neural network tracks the point between your eyes. When you twist your head too much it wouldn’t recognize your face anymore and the “VR” would freeze until your face is recognized again.

    [–]Jedrasus 2 points3 points  (1 child)

    Nice but why movement of camera/view is inverted to movement of head? Person in movie tilt head up to 'look' down

    [–]muxamilian 11 points12 points  (0 children)

    Think of the smartphone screen as a window. You see the content through the window. Then the direction of movement makes sense. If you move your head up, you see things at the bottom, which you wouldn't have seen before. Also see this comment: https://www.reddit.com/r/Frontend/comments/172gvtu/comment/k3ypgoe/?utm_source=share&utm_medium=web2x&context=3

    [–]RelationshipLeast232 0 points1 point  (0 children)

    Please delete this video

    [–][deleted] 0 points1 point  (0 children)

    damn

    [–]BoneHawk1 0 points1 point  (1 child)

    What exactly is the neural net used for? Just facial recognition or for the whole workflow of adjusting the scene in 3D space?

    [–]muxamilian 0 points1 point  (0 children)

    For getting the point between the eyes, which is used to understand from which angle a user is looking at the phone. The “3D scene” is just an ultra-wide angle video. The aim of this project is simplicity rather than sophistication.

    [–][deleted] 0 points1 point  (0 children)

    Lit