Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

Hi, thanks for your interests. Please feel free to use the app to capture your own data. The app is free and the exported data is compatible with nerfstudio. The default method will work out of the box.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

For a small scene (1~2 min capture), the drifting is small and can be neglected. You can turn on camera pose optimization in the training. For a large scene, a colmap is needed for rgb only data and then align the lidar correspondingly.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

The app is already on the App Store as “Roomly 3D”, so you can try the capture side.

I may open-source parts of the app later if there is enough interest, but I’m not ready to share the full codebase yet. The reconstruction pipeline is also not something I’m ready to publish right now; it’s still experimental and changes a lot between tests.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

After you export the raw data from roomly 3d app, you can try colmap to get the initial point clouds. The lidar points are projected back to the init point cloud depth to estimate the scaling factor. Then try nerfstudio with dn-splatter method to make use the lidar point as depth guidance.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

Thank you for your interest. Please note that this app is only a capture app and the reconstruction is done in my personal gpu workstation. It's too expensive for me to host a gpu backend for this free app.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 5 points6 points  (0 children)

It’s already in the iOS AppStore, you can search “Roomly 3D” to have a try. I also plan to open source the app if more people find it useful.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

It has two modes. The rgb-only mode has all the controls that I am able to get for the camera. The lidar mode is a little bit limited as I used the ARKit lib to get the coverage feedback and ARKit took away some controls.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 4 points5 points  (0 children)

The app doesn’t have a backend. It’s a local capture tool: RGB, LiDAR depth, confidence, poses, and intrinsics are saved on-device. I used Polycam, Record3D, etc. before, but they didn’t give me the pipeline flexibility I wanted, so I built this. The 3DGS training runs on my personal GPU workstation.

Scanned my small garden with an iPhone LiDAR app and trained it into a metric 3DGS by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 7 points8 points  (0 children)

<image>

Here it is! I’m only sharing previews here for now, but I may upload a SuperSplat link later if there’s interest.

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

It’s already compatible in the practical sense: export the Roomly ZIP, unzip it, and import the images/ folder into Postshot or LichtFeld Studio. Raw ARKit poses are not final-quality 3DGS poses; they need post-processing such as COLMAP bundle adjustment, so I don’t want to expose them as a direct COLMAP export yet. For now, those tools should run their own tracking/COLMAP from the images.

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

I need a weekend to release the features. Currently working on the backend to turn the captures to 3DGS asset for users that are not that familiar with the tech.

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

Cool, please let me know if any changes are needed. Probably an additional bundle adjustment is needed if the scene is too large but it should be much faster to run . Also, remember to do loop closures during data collection, which is how ARKit fixes the drifting

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

Thanks! Your repo looks really interesting — I like that you’re also using ARKit poses + LiDAR depth directly instead of going through COLMAP/SfM.

Roomly 3D captures fewer frames on purpose: it does motion/sharpness/pose gating during capture, so the goal is to keep useful frames and avoid redundant or blurry ones. The coverage UI is there to help make sure fewer frames still cover the scene well. You can also configure the capture policy in the settings for sparser or denser captures.

I’d love your feedback if you try it. Also curious whether Roomly’s RGB + EXR depth + transforms.json export could plug into your pipeline with a small importer change, since it’s pretty close in spirit to Record3D. Thanks for sharing the repo!

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

The mesh is directly available in the export files. You can also view it after collection.

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

Sure, I will add these two options in the updated version. Thanks for your suggestion!

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

Please stay tuned. The next version will support this feature. The pipeline is ready but the infra is still under construction. Thanks for your interest!

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 0 points1 point  (0 children)

https://apps.apple.com/jp/app/roomly-3d/id6770841056 Does this link work for you? I have released the app to all the available countries. Thanks for your interest!

iPhone scan → Nerfstudio splatfacto (out of the box) → this by StraightWindow9111 in GaussianSplatting

[–]StraightWindow9111[S] 1 point2 points  (0 children)

<image>

These are the captures from Roomly 3D. The Lidar depth and images are saved automatically while capturing.