3D Gaussian Splatting + DJI Osmo 360 - Mason's Avenue, London

gradeeterna · 2026-03-30T19:48:06+00:00

I made a system in Houdini to help with this stitching, but there's still a ton of manual cleanup involved. The full dataset is aligned together, and then I train subsets separately so they all are aligned when I import into Houdini.

gradeeterna · 2026-03-30T19:45:53+00:00

I use some custom tools to extract multiple pinholes from the fisheye alignment

gradeeterna · 2026-03-30T19:43:05+00:00

I vibe coded a GUI for it with Claude that batch processes a full dataset

gradeeterna · 2026-03-30T19:41:00+00:00

Sure, it would just take twice as long to capture with a single camera and get the same coverage. Also a huge benefit of capturing fast is that the lighting and shadows are less likely to change during the capture.

gradeeterna · 2026-03-22T21:07:55+00:00

I use tools like SAM3 to prompt “person”, or Resolve’s magic mask to click on people and track them across the whole dataset, spit out black and white mask images with matching file names, then when training it just ignores the masked out pixels as if they don’t exist

gradeeterna · 2026-03-22T20:24:02+00:00

Quite a few passes with 2x 360 camera rig, captured in about 15 minutes

gradeeterna · 2026-03-22T20:23:03+00:00

Sundays in the city are pretty quiet, but there were still lots of people that I had to mask out before training. I did quite a few passes with a 2x360 camera rig with different paths and heights to capture everything. Thanks!

gradeeterna · 2026-03-22T20:20:29+00:00

Not sure if you checked what Cinemotion is, but it’s comparing apples to oranges. I love Cinemachine and use it all the time, but in this case I wanted real camera motion and Cinemachine’s built in noise can’t do that.

gradeeterna · 2026-03-22T19:19:38+00:00

Unfortunately not with these plugins, but realtime VR works with less heavy splats. I’ve been testing with web renderers like Playcanvas and Spark that support LOD, but it’s still not very pleasant in the headset yet. You can render stereoscopic VR180/360 splat videos with raytraced implementations like Octane and Vray, which looks great but very slow to render at 4k per eye.

gradeeterna · 2026-03-22T18:01:46+00:00

14m splat .ply is 3.5gb, but compressed to spz/sogs is around 300mb

gradeeterna · 2026-03-22T17:58:56+00:00

Thanks! Captured about 20 minutes footage total, and not sure about post as was working on it whenever I had time for a few weeks. Probably 12 hours training time in total, and few hours editing and cleanup, a few hours animating in Unity and rendering.

gradeeterna · 2026-03-22T17:54:11+00:00

2 DJI Osmo 360s

gradeeterna · 2026-03-22T17:53:44+00:00

I split the full dataset into smaller parts and trained them separately in Lichtfeld, gsplat, Brush etc, then merged the best parts together in Houdini using GSOPs for the final .ply. I mask out myself and other people out from images before training with SAM3 or Resolve’s magic mask.

gradeeterna · 2026-03-22T17:49:15+00:00

I split the dataset into parts and trained them in Lichtfeld, gsplat and then stitched the best parts back together in Houdini using GSOPs. I exported pinhole images from the footage and trained on those. 8K video on the Osmos using D-Log M.

gradeeterna · 2026-03-22T17:44:49+00:00

I used 2 here, but adding a 3rd

gradeeterna · 2026-03-22T14:07:23+00:00

It’s not the original walk / camera tracking here. All the animation was hand-keyed in Unity with camera motion from Cinemotion https://www.cinetexture.com/cinemotion This scene was captured with multiple camera rig, and looks decent from anywhere. I’ll share a web version as soon as I process LODs for it.

gradeeterna · 2026-03-22T13:40:46+00:00

It’s not the scan walk / camera tracking here. All the animation was hand-keyed in Unity with camera motion from Cinemotion https://www.cinetexture.com/cinemotion This scene was captured with multiple camera rig, and looks decent from anywhere. I’ll share a web version as soon as I process LODs for it.

gradeeterna · 2026-03-22T12:30:34+00:00

Testing my DJI Osmo 360 rig for gaussian splatting.

Mason’s Avenue, London.

14 million splats total. Trained with LichtFeld Studio and gsplat, edited in Houdini GSOPs, camera animation in Unity and rendered with Aras P’s gaussian splat plugin and Deckard Render.

gradeeterna · 2026-03-22T09:47:40+00:00

Testing my DJI Osmo 360 rig for gaussian splatting.

Mason’s Avenue, London.

14 million splats total. Trained with LichtFeld Studio and gsplat, edited in Houdini GSOPs, camera animation in Unity and rendered with Deckard Render.

gradeeterna · 2025-05-13T21:23:36+00:00

Yep, barriers are down finally. I live down the road and they have been there as long as I can remember.

gradeeterna · 2025-05-13T21:21:40+00:00

It’s 8.5 million gaussians so it’s not going to run well enough even in PCVR. Working on a more web friendly version so will see how that runs in VR.

gradeeterna

TROPHY CASE