Get 3D object shape using multiview diffusion with view-dependent training with MVD2
Get 3D object shape using multiview diffusion with view-dependent training with MVD2
MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion
arXiv paper abstract https://arxiv.org/abs/2402.14253
arXiv PDF paper https://arxiv.org/pdf/2402.14253.pdf
... a promising 3D generation technique, multiview diffusion (MVD) ... By finetuning pretrained large image diffusion models with 3D data, the MVD methods first generate multiple views of a 3D object based on an image or text prompt and then reconstruct 3D shapes with multiview 3D reconstruction.
... present MVD2, an efficient 3D reconstruction method for multiview diffusion (MVD) images ... aggregates image features into a 3D feature volume by projection and convolution and then decodes volumetric features into a 3D mesh.
... train MVD2 with 3D shape collections and MVD images prompted by rendered views of 3D shapes.
To address the discrepancy between the generated multiview images and ground-truth views of the 3D shapes, ... design a simple-yet-efficient view-dependent training scheme.
MVD2 improves the 3D generation quality of MVD and ... can ... decode 3D meshes from multiview images within one second.
... demonstrate its superior performance in generating 3D models from multiview images generated by different MVD methods, using both synthetic and real images as prompts.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
