← Back to papers
2019 ACL ACL 2019

A Multilingual BPE Embedding Space for Universal Sentiment Lexicon Induction

Abstract

AbstractWe present a new method for sentiment lexicon induction that is designed to be applicable to the entire range of typological diversity of the world’s languages. We evaluate our method on Parallel Bible Corpus+ (PBC+), a parallel corpus of 1593 languages. The key idea is to use Byte Pair Encodings (BPEs) as basic units for multilingual embeddings. Through zero-shot transfer from English sentiment, we learn a seed lexicon for each language in the domain of PBC+. Through domain adaptation, we then generalize the domain-specific lexicon to a general one. We show – across typologically diverse languages in PBC+ – good quality of seed and general-domain sentiment lexicons by intrinsic and extrinsic and by automatic and human evaluation. We make freely available our code, seed sentiment lexicons for all 1593 languages and induced general-domain sentiment lexicons for 200 languages.

🌉 Interdisciplinary Bridge — Artificial Intelligence and Deep Learning and Machine Learning and Natural Language Processing
🧭 Keyword Pioneer — sentiment lexicon induction
🐣 Hot Topic Early Bird — zero-shot transfer
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Mengjie Zhao , Hinrich Schütze

Topics

Artificial Intelligence > Learning Paradigms > Transfer Learning Machine Learning > Core Methods > Embedding Learning Machine Learning > Learning Types > Zero-Shot Learning Machine Learning > Application Areas > Domain Adaptation Natural Language Processing > Applications > Sentiment Analysis Deep Learning > Learning Types > Representation Learning

Keywords

domain adaptation zero-shot transfer multilingual embedding byte pair encoding sentiment lexicon sentiment lexicon induction
Download PDF

Related papers

What do phone embeddings learn about Phonology? 2019
Unsupervised Morphological Segmentation for Low-Resource Polysynthetic Languages 2019
Understanding Undesirable Word Embedding Associations 2019
Inferential Machine Comprehension: Answering Questions by Recursively Deducing the Evidence Chain from Text 2019
Domain Adaptation of Neural Machine Translation by Lexicon Induction 2019