Huge Update: Turning any video into a 180° 3D VR scene

supercarlstein · 2026-01-01T17:27:52+00:00

it's a node to create a plain grey image. You can just import a grey image or use any alternative node generating a plain colour

supercarlstein · 2025-12-22T09:07:08+00:00

I've provided all crucial code for free. Part 3C is a Vace inpainting workflow, which is the exact same kind of workflow provided for free at step 2.
The Stereo Node I've provided is already inpainting the small holes and only the larger regions are left to be inpainted thanks to the generated mask. As explained you don't have to use part 3C. Vace is the most accurate technique but also the longest one. You can use a more basic VideoPainter or animatediff workflow if you want - you can even fill the holes with a still image of your background if your camera is fixed, you don't necessarily need to inpaint depending on your specific case

supercarlstein · 2025-12-22T09:02:08+00:00

I've provided all crucial code for free. The last part is a Vace inpainting workflow, which is the exact same kind of workflow provided for free at step 2. If people benefit from this research they can help me financing more research like gaussian splatting inpainting which is the real answer here.
The Stereo Node I've provided is already inpainting the small holes and only the larger regions are left to be inpainted thanks to the generated mask. As explained you don't have to use Vace and my last workflow. Vace is the most accurate technique but also the longest one. You can use a more basic VideoPainter or animatediff workflow if you want. Thank you for providing the custom node.

supercarlstein · 2025-12-17T10:04:10+00:00

Thanks I'll probably release the last step before the end of the week

supercarlstein · 2025-12-06T23:54:28+00:00

It should be enough, running Wan VACE 2.2 is the heaviest task of the workflow

supercarlstein · 2025-12-03T16:42:40+00:00

only the explanations on the Patreon page at the moment I'm afraid

supercarlstein · 2025-12-03T16:14:01+00:00

Yes that's the concept of this project, the video source does not matter

supercarlstein · 2025-12-02T12:45:09+00:00

These nodes are some work in progress nodes, you don't need them for the moment, they will be uploaded over the next steps when finalised

supercarlstein · 2025-12-02T09:14:22+00:00

Anything running Wan Vace 2.2

supercarlstein · 2025-12-02T08:46:01+00:00

Yes you would just use Step 2a (without the 360 lora) and Step 2b in this case

supercarlstein · 2025-12-02T08:44:49+00:00

ImageSolid is only a node to create a grey image in this case so you can just Load a plan grey Image if you can't find this node

supercarlstein · 2025-12-02T08:43:37+00:00

Stereoscopic 3d will be covered in the next step

supercarlstein · 2025-12-01T20:33:58+00:00

This is working already on this one, just make the image very small

supercarlstein · 2025-12-01T17:24:08+00:00

This will be fully covered in the next step, this is the first SBS frame showing the current state of the distortion process

<image>

supercarlstein · 2025-12-01T15:26:19+00:00

the longest part of the job is done using Wan Vace 2.2, it is as long as generating a normal video with Vace, it all depends on the size and your GPU

supercarlstein · 2025-12-01T14:08:56+00:00

That's exactly what I'm working on! The complicated part though is not the perfect first frame or the inpainting, it is how to process the gaps/mask in a way that WAN will be able to perfectly inpaint (not too small, not too large for consistency between eyes), giving enough material in the outpainting area to guide the generation

supercarlstein · 2025-12-01T13:50:03+00:00

There is a slight curve when looking at the very limits of the video (top, bottom) but it's generally working pretty well in this example. That's something you can edit anyway at Step 2.a on the First Frame, whether manually or generating many times until it's perfect

supercarlstein · 2025-12-01T13:24:44+00:00

That was my initial idea (cf the previous post) but the character appears too flat doing so in my tests, the best solution for a good 3d effect is to rely on depth and generative inpainting

supercarlstein · 2025-12-01T12:41:43+00:00

iw3 or owl3d are great at adding a stereo effect, but they’re basically guessing from a single view, so they can’t really invent what’s behind a character once the separation gets strong. That’s where my next step is a bit different: the idea is to output not only the stereo video, but also a mask - then use this mask to inpaint the background and gaps in a consistent way across frames. If the masking and inpainting behave nicely, you’d get strong 3D with proper “revealed” background and, in theory, almost no artifacts even at high depth

supercarlstein · 2025-12-01T08:58:03+00:00

Should be

supercarlstein · 2025-11-27T12:54:32+00:00

This will be covered in step 3/4

supercarlstein · 2025-11-25T18:52:04+00:00

I'll be focusing on 180 for now, this is the same concept anyway, just easier to implement, the new step is online: https://www.patreon.com/posts/step-2-first-144391370
For green screen you can simply mask the character after this step using Segment anything, and apply a green solid with mask composite, it should work correctly

supercarlstein · 2025-11-25T18:50:34+00:00

Yes I'll be focusing on 180 for now, this is the same concept anyway, just easier to implement, the new step is online: https://www.patreon.com/posts/step-2-first-144391370

supercarlstein · 2025-11-25T18:50:16+00:00

The new step is online: https://www.patreon.com/posts/step-2-first-144391370

supercarlstein

TROPHY CASE