Answering Questions about Charts and Generating Visual Explanations
Citations Over TimeTop 10% of 2020 papers
Abstract
People often use charts to analyze data, answer questions and explain their answers to others. In a formative study, we find that such human-generated questions and explanations commonly refer to visual features of charts. Based on this study, we developed an automatic chart question answering pipeline that generates visual explanations describing how the answer was obtained. Our pipeline first extracts the data and visual encodings from an input Vega-Lite chart. Then, given a natural language question about the chart, it transforms references to visual attributes into references to the data. It next applies a state-of-the-art machine learning algorithm to answer the transformed question. Finally, it uses a template-based approach to explain in natural language how the answer is determined from the chart's visual features. A user study finds that our pipeline-generated visual explanations significantly outperform in transparency and are comparable in usefulness and trust to human-generated explanations.
Related Papers
- → Improving the Question Answering Quality using Answer Candidate Filtering based on Natural-Language Features(2021)4 cited
- Question answering systems: a partial answer(2007)
- → Similarity Detection of Natural-Language Questions and Answers using the VANiLLa dataset(2021)2 cited
- → Mobile System Using Natural Language Annotations for Question Answering(2009)1 cited
- → Towards a question answering system based on precisiated natural language(2011)1 cited