2017 ACL ACL 2017

A Corpus of Natural Language for Visual Reasoning

Abstract

AbstractWe present a new visual reasoning language dataset, containing 92,244 pairs of examples of natural statements grounded in synthetic images with 3,962 unique sentences. We describe a method of crowdsourcing linguistically-diverse data, and present an analysis of our data. The data demonstrates a broad set of linguistic phenomena, requiring visual and set-theoretic reasoning. We experiment with various models, and show the data presents a strong challenge for future research.

🌉 Interdisciplinary Bridge — Artificial Intelligence and Natural Language Processing
📈 Trend Setter — Question Answering
🧭 Keyword Pioneer — visual question answering
🐝 Cross-Pollinator — Artificial Intelligence, Computer Vision, Deep Learning, Healthcare & Medicine, Knowledge & Reasoning, Machine Learning, Natural Language Processing, Reinforcement Learning
🐣 Hot Topic Early Bird — visual reasoning