3D Reconstruction - COLMAP & NerfStudio integration

[selimozel03]

Is there a way to integrate the output of lingbot-map with colmap or directly train this point cloud with nerfstudio?

Currently working on 3D reconstruction and wanted to try this model for it, but I am not sure if lingbot is suitable for this task.

[MK040412]

I did 3d reconstruction with 4060 gpu.

I think it is possible, and I think using high level idea of instant splat is quite straightforward and fast recipe.

Lingbot-map already gives you everything COLMAP would : per-frame extrinsic (world --> cam, same convention as COLMAP), intrinsic, and dense depth.

You don't need to run SfM at all (just serialize the predictions into a COLMAP text model that nerfstudio/gsplat can read directly)

Here is the example.

First : Camera Video
Second : Env with lingbot map and 3dgs in Isaac Sim

dormitory_recon.mp4

Isaac_Example.webm