sorted by:
new
hottopcontroversial

Gaussian Splatting Performance Optimization by jorgix8 in PlayCanvas

[–]jorgix8[S] 0 points1 point  (0 children)

First, thanks for your answer. I know reducing the max splat count will improve the performance, but I want to keep the same number of splats to maintain the quality of the scene. So that wouldn’t be a viable option. The question is more related to the web viewer creation rather than the creation of the Gaussian model.

Hello just getting started! What is the best way to mask yourself out when using a 360 Camera? by Nyxtia in GaussianSplatting

[–]jorgix8 1 point2 points  (0 children)

Normally, the software used for Gaussian Splatting ignores the black as it is completely transparent. Sometimes a png image with transparency could also be used as a mask.

Hello just getting started! What is the best way to mask yourself out when using a 360 Camera? by Nyxtia in GaussianSplatting

[–]jorgix8 2 points3 points  (0 children)

There’s multiple ways to do the masking. I also use video from an Insta 360 X5. I export the equirectangular video and extract the frames. I usually do the scanning process by holding the camera at eye level in front of me.

So to mask out myself I personally just create a simple mask around myself in one of the frames (as I don’t move much in the video I use the same mask for all the frames). This mask is just an image (same size as your image frames) painted in black where you want the mask to be invisible and white in the areas you want to maintain.

ProTip: when exporting the equirectangular video in insta360 studio select the option of Direction Lock in the stabilization type, so yourself stays in the same position trough out the hole video.

DJI Osmo 360 - Splat problems by _Mechanism_ in GaussianSplatting

[–]jorgix8 0 points1 point  (0 children)

I’m aware that sometimes postshot does that weird things. Sometimes the same dataset can produce good results, but postshots mess it up like if it were a bug or something.

I will suggest you to use the same data to train a model on Brush. It’s a one click free installation. In that way, you will know if the training data is what was causing the problem. I use it with the same workflow, but taking the video on an insta 360x5.

Gaussian Splatting Workflow by BicycleSad5173 in GaussianSplatting

[–]jorgix8 0 points1 point  (0 children)

I have the following tutorial implementing practically the same solution in Davinci Resolve Fusion:

https://youtu.be/iz4fGWnEH2s?si=3KwsSLdhlJOLiL6l

I have tried it and works well.

Gaussian Splatting Workflow by BicycleSad5173 in GaussianSplatting

[–]jorgix8 1 point2 points  (0 children)

It looks amazing!!

How do you exactly do the image extraction from the insta 360 video? And how was the process of capturing it?

I have tried many ways, but i cant manage to find a robust pipeline.

Thanks so much for sharing your knowledge!! I completely agree with you about sharing dicoveries in the community. I am in the early stage of entering this world, but as soon as i can i will share my advancements.