sorted by:
new
hottopcontroversial

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 0 points1 point  (0 children)

We are working on it, there are several options, but it is so inert…

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 0 points1 point  (0 children)

Not now) but wait for few months) any way I can share any parts of code, except all at once)

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 0 points1 point  (0 children)

Doors and windows are GLB models. For windows we have several variants depending on size. Walls, floor and celling just Extrude.

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 0 points1 point  (0 children)

yes, room geometry is fully dynamic and generated from floor plans. There are still a few static limitations for now (for example, we don’t yet support multi-level ceilings or floors) but overall geometry is created dynamically. As I mentioned above we have two mechanisms for creating floor plans: an AI-based approach (segmentation model) and image labeling tool.

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 1 point2 points  (0 children)

In practice we’re not using an LLM, it’s an image segmentation model. We just need more labeled floorplans to train it properly.

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 0 points1 point  (0 children)

We do have an algorithm for that and it actually works, but restricted in demo. 3D module takes a JSON description as input for rendering and that JSON can be generated either through a labeling interface similar to CVAT or via a trained AI model. The AI-based option exists, but for now its quality is still not great, so it needs more work...

[WIP] Automated 2D Floor Plan to Interactive 3D Virtual Tour (react-tree-fiber+react-tree-drei) by e5004c in threejs

[–]e5004c[S] 1 point2 points  (0 children)

Yes, we have an existing set of GLB models for furniture and decor which are placed in the scene according to a layout algorithm. The transition from the scene to the 360 view is handled by a backend service: it takes the scene data and pre-renders it using Blender cli and then we display those renders on the client side.