Indoor 3D scene reconstruction using a sparse 3D diffusion network with DiffRoom
Indoor 3D scene reconstruction using a sparse 3D diffusion network with DiffRoom
DiffRoom: Diffusion-based High-Quality 3D Room Reconstruction and Generation
arXiv paper abstract https://arxiv.org/abs/2306.00519
arXiv PDF paper https://arxiv.org/pdf/2306.00519.pdf
... present DiffRoom, a novel framework for tackling the problem of high-quality 3D indoor room reconstruction and generation, both of which are challenging due to the complexity and diversity of the room geometry.
Although diffusion-based generative models ... impressive performance in image generation and object-level 3D generation, they have not yet been applied to room-level 3D generation due to their computationally intensive costs.
... propose a sparse 3D diffusion network that is efficient and possesses strong generative performance for Truncated Signed Distance Field (TSDF), based on a rough occupancy prior.
Inspired by KinectFusion's incremental alignment and fusion of local SDFs, ... propose a diffusion-based TSDF fusion approach that iteratively diffuses and fuses TSDFs, facilitating the reconstruction and generation of an entire room environment.
... introduce a curriculum diffusion learning paradigm that speeds up the training convergence process and enables high-quality reconstruction.
... mesh quality generated by ... DiffRoom can even outperform the ground truth mesh provided by ScanNet.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments