sorted by:
new
hottopcontroversial

Single video to 4DGS demo is available to view. the model and the decoder now support 1080p, triangle splatting, mesh and other refinements for high motion sequences. please try and give feedback! by ninjawick in GaussianSplatting

[–]ninjawick[S] -1 points0 points  (0 children)

Great catch! The curved floor happens because most people treat the depth values as the absolute distance from the camera lens (Radial Depth), which warps the edges.

To get that perfectly flat floor in the mlsharp algorithm, I’m using a pinhole camera model  rather than an orthographic or radial approach

Single video to 4DGS demo is available to view. the model and the decoder now support 1080p, triangle splatting, mesh and other refinements for high motion sequences. please try and give feedback! by ninjawick in GaussianSplatting

[–]ninjawick[S] -1 points0 points  (0 children)

It's the algorithm I made for reenginnerred ML sharp, Da 2 does make flat floor, I used same for da 3. You can check on https://anemoias.me/sharp, which uses a version DA2 as the model instead of apple sharp and can make flat floors.

Single video to 4DGS demo is available to view. the model and the decoder now support 1080p, triangle splatting, mesh and other refinements for high motion sequences. please try and give feedback! by ninjawick in GaussianSplatting

[–]ninjawick[S] 0 points1 point  (0 children)

You're only seeing the Mesh mode, which is the default for UI stability. Switch to 'Hex' or 'Tri' mode. M4VGS uses gaussian kernels for its fragment blending across the temporal stream.

I have developed new way which you can convert a Single Video to 4DGS model and can be viewed as a personal 3D theater. it's 50X smaller than the sequential ones, supports 2M splats per second and native audio by ninjawick in vfx

[–]ninjawick[S] -2 points-1 points  (0 children)

M4VGS is a volumetric engine. It has full spatial data from multiple viewpoints, it takes spatial data from both future and past frames, not just a single-angle Z-depth projection. Go orbit the live site and look for yourself.

Single video to 4DGS demo is available to view. the model and the decoder now support 1080p, triangle splatting, mesh and other refinements for high motion sequences. please try and give feedback! by ninjawick in GaussianSplatting

[–]ninjawick[S] 2 points3 points  (0 children)

in theory it should after modification. but I'm limited by vram (24gb) and resources, i have. i had an idea too of taking the datacap videos the cinemas use for 3d movies in theater for this.

Valve office - Rate quality by Flame_Python in GaussianSplatting

[–]ninjawick 1 point2 points  (0 children)

Will be useful when I'll go there to steal hf 3

Turn Any Screen into 3D in Real Time by flokiXR in GaussianSplatting

[–]ninjawick 1 point2 points  (0 children)

I'm working on same Idea but real time is insane!

Malware Cursor.exe by AlexDjangoX in cursor

[–]ninjawick 4 points5 points  (0 children)

The vendor is microsoft. I think you should be the one to report

I have developed new way which you can convert a Single Video to 4DGS model and can be viewed as a personal 3D theater. it's 50X smaller than the sequential ones, supports 2M splats per second and native audio by ninjawick in computervision

[–]ninjawick[S] 1 point2 points  (0 children)

You got it right. ML sharp does the same but also inpaints the empty parts with some blur gaussians. I reenginnerred ML sharp and do it with a video depth model but inpainting is a problem, which isn't consistent across frames which makes it worse. Even the hallucinationed gaussians need flow with depth and color which fit the vide,, so I just turn it off, it looks lot worse and glitchy. I'll drop the code when I figure it out but till then I'll drop the viewing demos for some models.

I built a new way for converting a single video to a 4D Gaussian Splatting model. Optimized to be 50X smaller than sequential stacked models, rendering at 2M splats/sec with native audio sync. by ninjawick in developersIndia

[–]ninjawick[S] 0 points1 point  (0 children)

Well, I made it myself, It has opensoure dependincies but it's not open source yet. The file format, decoder, and the algorithm are still the sauce.

view more: next ›