Answer questions about a news video with NEWSKVQA
Answer questions about a news video with NEWSKVQA
NEWSKVQA: Knowledge-Aware News Video Question Answering
arXiv paper abstract https://arxiv.org/abs/2202.04015v1
arXiv PDF paper https://arxiv.org/pdf/2202.04015v1.pdf
Answering questions in the context of videos can be helpful in video indexing, video retrieval systems, video summarization, learning management systems and surveillance video analysis.
... exists a large body of work on visual question answering, work on video question answering (1) is limited to domains like movies, TV shows, gameplay, or human activity, and (2) is mostly based on common sense reasoning.
... explore ... answering knowledge-based questions in the context of news videos.
... curate a new dataset of 12K news videos spanning across 156 hours with 1M multiple-choice question-answer pairs covering 8263 unique entities.
We make the dataset publicly available.
... propose a novel approach, NEWSKVQA (Knowledge-Aware News Video Question Answering) which performs multi-modal inferencing over textual multiple-choice questions, videos, their transcripts and knowledge base, and presents a strong baseline.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments