Answer questions about scene using image and 3D information
Answer questions about scene using image and 3D information
3D Question Answering
arXiv paper abstract https://arxiv.org/abs/2112.08359v1
arXiv PDF paper https://arxiv.org/pdf/2112.08359v1.pdf
Visual Question Answering (VQA) has ... tremendous progress in recent years. However, most efforts ... on the 2D image question
... present the first attempt at extending VQA to the 3D domain, which can facilitate artificial intelligence's perception of 3D real-world scenarios.
... 3D Question Answering (3DQA) takes the color point cloud as input and requires both appearance and 3D geometry comprehension ability
... propose a novel transformer-based 3DQA framework "3DQA-TR" ... consists of two encoders for ... appearance and geometry information
... The multi-modal information of appearance, geometry, and the linguistic question can ... attend to each other via a 3D-Linguistic Bert to predict the target answers.
... demonstrate the obvious superiority of our proposed 3DQA framework over existing VQA frameworks, and the effectiveness of our major designs.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments