Get 3D object shape from one image by using reference-guided novel view enhancement with HiFi-123

Get 3D object shape from one image by using reference-guided novel view enhancement with HiFi-123

HiFi-123: Towards High-fidelity One Image to 3D Content Generation

arXiv paper abstract https://arxiv.org/abs/2310.06744

arXiv PDF paper https://arxiv.org/pdf/2310.06744.pdf

Project page https://drexubery.github.io/HiFi-123

Recent advances in text-to-image diffusion models have enabled 3D generation from a single image.

However, current image-to-3D methods often produce suboptimal results for novel views, with blurred textures and deviations from the reference image

... introduce HiFi-123, a method designed for high-fidelity and multi-view consistent 3D generation.

... First, ... propose a reference-guided novel view enhancement technique that substantially reduces the quality gap between synthesized and reference views. Second, ... present a novel reference-guided state distillation loss.

When incorporated into the optimization-based image-to-3D pipeline, ... method significantly improves 3D generation quality, achieving state-of-the-art performance.

... demonstrate the effectiveness of ... approach over existing methods, both qualitatively and quantitatively.

Please like and share this post if you enjoyed it using the buttons at the bottom! Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact Web site with my other posts by category https://morrislee1234.wixsite.com/website LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b #ComputerVision #3D #AINewsClips #AI #ML #ArtificialIntelligence #MachineLearning