Real-time detection of 3D planes in video by merging observations with PlanarRecon
Real-time detection of 3D planes in video by merging observations with PlanarRecon
PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videos
arXiv paper abstract https://arxiv.org/abs/2206.07710
arXiv PDF paper https://arxiv.org/pdf/2206.07710.pdf
Twitter video https://twitter.com/ak92501/status/1537316756880072705
Project page https://neu-vi.github.io/planarrecon
... present PlanarRecon -- a novel framework for globally coherent detection and reconstruction of 3D planes from a posed monocular video.
... PlanarRecon incrementally detects planes in 3D for each video fragment, which consists of a set of key frames, from a volumetric representation of the scene using neural networks.
A learning-based tracking and fusion module is designed to merge planes from previous fragments to form a coherent global plane reconstruction.
... PlanarRecon ... integrate observations from multiple views within each fragment and temporal information across different ones, resulting in an accurate and coherent reconstruction of the scene abstraction with low-polygonal geometry.
... achieves state-of-the-art performances on the ScanNet dataset while being real-time.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments