Get many 3D object shapes using SAM, 3DGS, Stabled Diffusion, and SuGaR with OMEGAS
Get many 3D object shapes using SAM, 3DGS, Stabled Diffusion, and SuGaR with OMEGAS
OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation
arXiv paper abstract https://arxiv.org/abs/2404.15891
arXiv PDF paper https://arxiv.org/pdf/2404.15891.pdf
... delve into ... 3D reconstruction of specific objects within large scenes and propose ... OMEGAS: Object Mesh Extraction from Large Scenes Guided by GAussian Segmentation.
OMEGAS employs a multi-step approach ... initially... utilize the Segment Anything Model (SAM) to guide the segmentation of 3D Gaussian Splatting (3DGS), thereby creating a basic 3DGS model of the target object.
... leverage large-scale diffusion priors to ... refine the details of the 3DGS model, especially aimed at addressing invisible or occluded object portions from the original scene views.
... by re-rendering the 3DGS model onto the scene views, ... achieve accurate object segmentation and effectively remove the background.
Finally, these target-only images are used to improve the 3DGS model further and extract the definitive 3D object mesh by the SuGaR model.
... experiments demonstrate that OMEGAS significantly surpasses existing scene reconstruction methods ...
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contactÂ
Web site with my other posts by category https://morrislee1234.wixsite.com/websiteÂ
