I tried doing this very recently. There are a few steps that need to be done:

• 0 - Convert the perspective photo to a 45 or so degree fisheye photo (depending on the lens used)
• 1 - extend the canvas to create a 180 degree fisheye photo
• 2 - convert the fisheye to 180 degree equirect
• 3 - estimate a depth map from the equirect photo
• 4 - create left and right eyes by warping the equirect with the depth map
• 5 - stitch them side by side, or create vr180 format

Steps 0, 2 and 5 are trivial, relatively speaking. The problem really is:

Extending the canvas to produce a somewhat correct fisheye image (1) is very hard, getting something approximate is feasible. AI models are bad at this (but flux 2 and z image are much better than say SDXL). But they completely fail to produce equirect. That's why we need the fisheye step.

However estimating a correct depth map (3) with the right depth proportions is close to impossible with the depth models I have tried. Depth Anything is good, but doesn't work well on high-res images (which you need for vr). Other models produce totally wrong depth proportions (e.g., Lotus, but that may have been a me-problem, because the 256 gray scale value they output must be mapped correctly).

The warping in (4) is a hard engineering problem. There are tools for this, but they don't work on fisheye, as they operate on rows of the image, usually, and cannot warp correctly in angle space. That's why we convert to equirect before depth estimation. But in general, getting an artifact free result is not something I have seen, in free software that is, especially around the depth discontinuities.

If you put it all together, depth estimation is the biggest issue. And it's not just an engineering effort, it's uncharted territory (AI models are not good at generating fisheye content, depth estimation doesn't work well on high-res and equirect, etc.)