Get many 3D object shapes in one image using spatially-aware diffusion guidance with ComboVerse
Get many 3D object shapes in one image using spatially-aware diffusion guidance with ComboVerse
ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidance
arXiv paper abstract https://arxiv.org/abs/2403.12409
arXiv PDF paper https://arxiv.org/pdf/2403.12409.pdf
Project page https://cyw-3d.github.io/ComboVerse
Generating high-quality 3D assets from ... image is highly desirable ... Though promising results ... in single object generation ... often struggle to model ... multiple objects.
... present ComboVerse, a 3D generation framework that produces high-quality 3D assets with complex compositions by learning to combine multiple models.
1) ... first perform an in-depth analysis of this ``multi-object gap'' from both model and data perspectives.
2) Next, with reconstructed 3D models of different objects, ... seek to adjust their sizes, rotation angles, and locations to create a 3D asset that matches the given image.
3) To automate this process, ... apply spatially-aware score distillation sampling (SSDS) from pretrained diffusion models to guide the positioning of objects.
... ComboVerse achieves clear improvements over existing methods in generating compositional 3D assets.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments