Reconstruct 3D unknown object from a single view by mapping image to points with ZeroMesh
Reconstruct 3D unknown object from a single view by mapping image to points with ZeroMesh
ZeroMesh: Zero-shot Single-view 3D Mesh Reconstruction
arXiv paper abstract https://arxiv.org/abs/2208.02676v1
arXiv PDF paper https://arxiv.org/pdf/2208.02676v1.pdf
Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images.
Most ... deep learning based ... methods ... cannot work well when handling objects from novel categories that are not seen during training.
... propose an end-to-end two-stage network, ZeroMesh, to break the category boundaries in reconstruction.
... factorize the complicated image-to-mesh mapping into ... image-to-point mapping and point-to-mesh mapping, while the latter is ... less dependent on object categories.
... devise a local feature sampling strategy in 2D and 3D feature spaces to capture the local geometry shared across objects
... method significantly outperforms the existing works on the ShapeNet and Pix3D under different scenarios and various metrics, especially for novel objects.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments