Reconstruct 3D object from one image using diffusion image generator with RealFusion
Reconstruct 3D object from one image using diffusion image generator with RealFusion
RealFusion: 360° Reconstruction of Any Object from a Single Image
arXiv paper abstract https://arxiv.org/abs/2302.10663
arXiv PDF paper https://arxiv.org/pdf/2302.10663.pdf
... consider the problem of reconstructing a full 360 degree photographic model of an object from a single image of it.
... do so by fitting a neural radiance field to the image, but find this problem to be severely ill-posed.
... thus take an off-the-self conditional image generator based on diffusion and engineer a prompt that encourages it to ``dream up'' novel views of the object.
Using an approach inspired by DreamFields and DreamFusion, ... fuse the given input view, the conditional prior, and other regularizers in a final, consistent reconstruction.
... demonstrate state-of-the-art reconstruction results on benchmark images when compared to prior methods for monocular 3D reconstruction of objects.
... reconstructions provide a faithful match of the input view and a plausible extrapolation of its appearance and 3D shape, including to the side of the object not visible in the image.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments