← Back to papers
2020 AAAI AAAI 2020

A Critique of the Smooth Inverse Frequency Sentence Embeddings (Student Abstract)

Abstract

Abstract We critically review the smooth inverse frequency sentence embedding method of Arora, Liang, and Ma (2017), and show inconsistencies in its setup, derivation and evaluation.

🌉 Interdisciplinary Bridge — Deep Learning and Machine Learning and Natural Language Processing
🧭 Keyword Pioneer — smooth inverse frequency
🐣 Hot Topic Early Bird — theoretical analysis
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Aidana Karipbayeva , Alena Sorokina , Zhenisbek Assylbekov

Topics

Machine Learning > Core Methods > Representation Learning Machine Learning > Optimization & Theory > Theory Natural Language Processing > Resources & Methods > Text Representation Natural Language Processing > Understanding > Lexical Semantics Deep Learning > Models > Language Modeling

Keywords

unsupervised learning natural language inference lexical semantics text representation theoretical analysis word embedding sentence embedding smooth inverse frequency
Download PDF

Related papers

Enhancing Pointer Network for Sentence Ordering with Pairwise Ordering Predictions 2020
CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning 2020
Neural Simile Recognition with Cyclic Multitask Learning and Local Attention 2020
Being Optimistic to Be Conservative: Quickly Learning a CVaR Policy 2020
Multi-Point Semantic Representation for Intent Classification 2020