← Back to papers
2020 EMNLP EMNLP 2020

Detecting Entailment in Code-Mixed Hindi-English Conversations

Abstract

AbstractThe presence of large-scale corpora for Natural Language Inference (NLI) has spurred deep learning research in this area, though much of this research has focused solely on monolingual data. Code-mixing is the intertwined usage of multiple languages, and is commonly seen in informal conversations among polyglots. Given the rising importance of dialogue agents, it is imperative that they understand code-mixing, but the scarcity of code-mixed Natural Language Understanding (NLU) datasets has precluded research in this area. The dataset by Khanuja et. al. for detecting conversational entailment in code-mixed Hindi-English text is the first of its kind. We investigate the effectiveness of language modeling, data augmentation, translation, and architectural approaches to address the code-mixed, conversational, and low-resource aspects of this dataset. We obtain an 8.09% increase in test set accuracy over the current state of the art.

🌉 Interdisciplinary Bridge — Deep Learning and Machine Learning and Natural Language Processing
🧭 Keyword Pioneer — conversational entailment
🐣 Hot Topic Early Bird — language model fine-tuning
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Sharanya Chakravarthy , Anjana Umapathy , Alan W Black

Topics

Deep Learning > Architectures > Transformers Natural Language Processing > Applications > Text Classification Natural Language Processing > Resources & Methods > Natural Language Inference Machine Learning > Learning Types > Transfer Learning Natural Language Processing > Applications > Natural Language Inference Natural Language Processing > Applications > Dialogue Systems Deep Learning > Learning Types > Multi-Modal Learning Machine Learning > Learning Types > Multi-Lingual Learning

Keywords

transfer learning text classification natural language inference data augmentation low-resource language language model language model fine-tuning dialogue system code-mixed language conversational entailment
Download PDF

Related papers

Fast semantic parsing with well-typedness guarantees 2020
Detecting Objectifying Language in Online Professor Reviews 2020
Analogous Process Structure Induction for Sub-event Sequence Prediction 2020
Aspect Sentiment Classification with Aspect-Specific Opinion Spans 2020
Robust and Interpretable Grounding of Spatial References with Relation Networks 2020