top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Answering questions about an image using outside knowledge

Answering questions about an image using outside knowledge


KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA

arXiv paper abstract https://arxiv.org/abs/2012.11014



One of the most challenging question types in VQA is when answering the question requires outside knowledge not present in the image.


... We tap into two types of knowledge representations and reasoning.

First, implicit knowledge which can be learned effectively from unsupervised language pre-training and supervised training ...

Second, explicit, symbolic knowledge encoded in knowledge bases.


... We combine diverse sources of knowledge to cover the wide variety of knowledge needed to solve knowledge-based questions.


... KRISP (Knowledge Reasoning with Implicit and Symbolic rePresentations), significantly outperforms state-of-the-art on OK-VQA, the largest available dataset for open-domain knowledge-based VQA. ...


Please like and share this post if you enjoyed it using the buttons at the bottom!


Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website


49 views0 comments

Comments


ClickBank paid link

bottom of page