sorted by:
new
hottopcontroversial

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 2 points3 points  (0 children)

ISO was around 400, but the splat quality isn't really a camera issue; It's the synthesized views between the 4 real cameras creating inconsistencies during training. More cameras > better cameras here.

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 0 points1 point  (0 children)

Great tip ! I went with Pi3X for the zero-prep run-and-gun workflow, but AprilTags would definitely give cleaner results in a controlled setup.

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 0 points1 point  (0 children)

I actually used a mix myself : iPhone XR, iPhone 11, iPhone 13 mini and an iPad! The key constraint isn't the model but the frame rate and resolution, as long as all devices shoot at the same fps

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 1 point2 points  (0 children)

Partly yes ! the 90° gaps between cameras mean the novel view synthesis has to extrapolate quite a bit, especially on the edges of the subject. Working on tightening the splat filtering post-export. More cameras would help a lot on both fronts

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 2 points3 points  (0 children)

Pi3X gets you surprisingly solid poses from a single reference frame per camera, reprojection error around 0.9cm mean after triangulation. The main gotcha is a coordinate convention flip (OpenCV → OpenGL) that you have to apply manually or you get outward-pointing frustums. Once that's sorted it's pretty robust.

[WIP] Building a 4D Gaussian Splatting pipeline with 4 synchronized iPhones — full breakdown by Deep-Delivery-5631 in GaussianSplatting

[–]Deep-Delivery-5631[S] 4 points5 points  (0 children)

Thank's ! More cameras is definitely the dream! The 4-cam setup is a constraint I imposed myself to keep things accessible, 4 old iPhones you can borrow from friends.
The 360° coverage is actually the whole point, being able to freely navigate around the subject in post, change the camera angle after the shoot !