Get 3D of unknown scene from from one image by extend depth estimation to make 3D shape with Flash3D
Get 3D of unknown scene from from one image by extend depth estimation to make 3D shape with Flash3D
Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image
arXiv paper abstract https://arxiv.org/abs/2406.04343
arXiv PDF paper https://arxiv.org/pdf/2406.04343
Project page https://www.robots.ox.ac.uk/~vgg/research/flash3d
In this paper, ... propose Flash3D, a method for scene reconstruction and novel view synthesis from a single image which is both very generalisable and efficient.
... start from ... model for monocular depth estimation and extend it to a full 3D shape and appearance reconstructor ... base this extension on feed-forward Gaussian Splatting.
... predict a first layer of 3D Gaussians at the predicted depth, and then add additional layers of Gaussians that are offset in space, allowing the model to complete the reconstruction behind occlusions and truncations.
Flash3D is very efficient, trainable on a single GPU in a day, and thus accessible to most researchers.
It achieves state-of-the-art results when trained and tested on RealEstate10k. When transferred to unseen datasets like NYU it outperforms competitors by a large margin.
... Flash3D achieves better PSNR than methods trained specifically on that dataset. In some instances, it even outperforms recent methods that use multiple views as input.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments