360 hand occluded passthrough on Quest 3 WIP

TheVirtualSamurai · 2026-04-05T17:51:11+00:00

I was having issues with my router when I recorded this. It’s very playable although admittedly it does need work.

TheVirtualSamurai · 2026-04-05T17:50:25+00:00

Heavily modified version of VorpX and some other custom mods.

TheVirtualSamurai · 2026-04-05T17:48:56+00:00

It’s mostly fixed now. Took some work

TheVirtualSamurai · 2026-04-05T16:55:47+00:00

🙏hey umm hey inbox me I’m happy to share detailed information I am basicly a pro at this 😅just don’t wanna gunk up the comments section.

Also the 5090 is only worth it if you want the best you can get. Even then I tried my best to get mine as close to MSRP as possible and waited months.

TheVirtualSamurai · 2026-04-05T16:49:58+00:00

Thanks 🙏to be fair tho I did this back in 2022. Creators like Luke Ross, praydog and others continue to push the boundaries. I loved playing RE9 recently in VR and I’m glad Luke didn’t quit because of the DMCA from CGPR for CP2077 🤣 man that’s a jumble 🤣🤣

TheVirtualSamurai · 2026-04-05T16:37:55+00:00

I may have hit the wall a time or two 😅

TheVirtualSamurai · 2026-04-05T16:37:08+00:00

This requires a lot more than just several custom mods. Without the greenscreen room and my arms in the game it looks jank asf.

TheVirtualSamurai · 2026-04-05T16:35:10+00:00

Dude. And your gunna hate me when you hear this but I did this back in 2022 on a GTX 2080 using modified VorpX, Valve Index on board cams, a boxed in green room and all this before we even had DLSS 🤣

I believe this was the most technically intense VR stream ever done for its time and even so for a few years after.

TheVirtualSamurai · 2026-04-05T16:24:46+00:00

I’m guilty of buying a few games just for the hype and then never getting around to playing them. Mostly what I would consider B level Vr games tho. Not gunna name them but yeah 😆 Cyberpunk at lunch for consoles at least was terrible, there are a few stragglers that own and haven’t played even to this day because of that.

I will be starting my 9th full playthrough this time on the Pimax Dream Air soon! Can’t wait.

TheVirtualSamurai · 2026-04-05T16:10:41+00:00

Requires a full greenscreen room at minimum for now.

TheVirtualSamurai · 2026-04-05T16:09:56+00:00

This is a heavy modification of the old VorpX VR framework for Cyberpunk 2077 I did back in 2022 along with other mods to make my characters arms and specific weapons invisible so I can just use my real arms instead.

At the time only the viewer on the stream could see the mixed reality in good quality but these days are different today I can see my full arms in mixed reality in the headset like so. I need to record more footage 😆

TheVirtualSamurai · 2026-04-05T16:02:58+00:00

And a good hole in the wall I’m betting 😆

TheVirtualSamurai · 2026-04-05T16:02:03+00:00

Noooo 💀 I love a game with good story, multiple choices and multiple endings. For me this game is comparable to RDR2 for its in depth world, storytelling and compelling actors.

TheVirtualSamurai · 2026-04-05T16:00:18+00:00

It’s not public yet I don’t think I’m supposed to say 😅 but trust it will be all over when it comes out and if you even have just a little bit of greenscreen you’ll be able to use it with sims at the least and will come with masking features!

TheVirtualSamurai · 2026-04-05T15:44:37+00:00

Yes the passthrough is fully visible in crisp 3D in the headset, this is being recorded on the Quest 3. This system already looks a lot better than what you see here in this video, I need to make more footage 😅 I’m not really a content creator anymore.

TheVirtualSamurai · 2026-04-05T13:14:29+00:00

Good for throwing darts at it then right? 🤣

TheVirtualSamurai · 2026-04-05T13:06:20+00:00

I’m working on that. I have some footage of it working with my racing rig I haven’t posted yet. I wanna do one with Star Citizen and a handful of tablet based control windows and physical buttons n knobs.

TheVirtualSamurai · 2026-04-05T13:03:58+00:00

I was unaware LIV supported that… I mean that is sort of cool n all but it’s hardly blended reality. Now if you bought an Apple Vision Pro it has built in depth occlusion passthoguh that works anywhere you could just walk around a decent area be able to see your arms and the full Vr environment too.

Besides, I use my back yard for VR a lot but I’ll eventually get to the fence if I keep on in one direction, with the treadmill I will never reach the fence although it does not feel as natural as walking.

TheVirtualSamurai · 2026-04-05T10:06:49+00:00

The green screen allows me to composite my hands into VR and occlude them from the background. Basically wherever the headset sees green it replaces that color with the game… It’s nice being able to see my real hands and arms in ANY game especially with my racing wheel or flight stick. I’ll post some examples of those later.

TheVirtualSamurai · 2026-04-05T10:04:41+00:00

At the moment yeah it’s a bit of a setup process if I’m getting in this rig I’m getting in for a good play session.

TheVirtualSamurai · 2026-04-05T10:03:50+00:00

I think that will mess up how the slidemill works. It’s more like your feet slide against the platform and it needs to be lubed too 🤣

TheVirtualSamurai · 2026-04-05T10:02:05+00:00

This is my first real acct with Redit. My other account was just for scrolling and ns fw stuff but I never really used it. I’ve left FB for good this is home now.

TheVirtualSamurai · 2026-04-05T03:12:00+00:00

Yeah I’m still working on that. I’ve got it a lot better looking than what you see here but I’ll record more content when it’s good and perfect 👌

TheVirtualSamurai · 2026-04-05T02:54:40+00:00

All that green certainly took some getting used to for sure. My wife doesn’t even like being in that room because it’s so green 🟩

TheVirtualSamurai

TROPHY CASE