0 citations0 references

VQA: Visual Question Answering

2015pp. 2425–2433

Citations Over TimeTop 1% of 2015 papers

Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh

Abstract

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios, such as helping the visually impaired, both the questions and answers are open-ended. Visual questions selectively target different areas of an image, including background details and underlying context. As a result, a system that succeeds at VQA typically needs a more detailed understanding of the image and complex reasoning than a system producing generic image captions. Moreover, VQA is amenable to automatic evaluation, since many open-ended answers contain only a few words or a closed set of answers that can be provided in a multiple-choice format. We provide a dataset containing ~0.25M images, ~0.76M questions, and ~10M answers (www.visualqa.org), and discuss the information it provides. Numerous baselines for VQA are provided and compared with human performance.

Related Papers

Question answering systems: a partial answer(2007)
→ Mobile System Using Natural Language Annotations for Question Answering(2009)1 cited
UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers(2007)
→ Towards a question answering system based on precisiated natural language(2011)1 cited
UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers (Notebook Version)(2007)