3D object retrieval using hand sketch, text, and image inputs with Schlachter
3D object retrieval using hand sketch, text, and image inputs with Schlachter
Zero-Shot Multi-Modal Artist-Controlled Retrieval and Exploration of 3D Object Sets
arXiv paper abstract https://arxiv.org/abs/2209.00682v1
arXiv PDF paper https://arxiv.org/pdf/2209.00682v1.pdf
When creating 3D content, highly specialized skills are generally needed to design and generate models of objects and other assets by hand.
... address this problem through high-quality 3D asset retrieval from multi-modal inputs, including 2D sketches, images and text.
... use CLIP as it provides a bridge to higher-level latent features.
... use these features to perform a multi-modality fusion to address the lack of artistic control that affects common data-driven approaches.
... approach allows for multi-modal conditional feature-driven retrieval through a 3D asset database, by utilizing a combination of input latent embeddings ...
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments