2016
NIPS
NeurIPS 2016
Matrix Completion has No Spurious Local Minimum
Abstract
Matrix completion is a basic machine learning problem that has wide applications, especially in collaborative filtering and recommender systems. Simple non-convex optimization algorithms are popular and effective in practice. Despite recent progress in proving various non-convex algorithms converge from a good initial point, it remains unclear why random or arbitrary initialization suffices in practice. We prove that the commonly used non-convex objective function for matrix completion has no spurious local minima --- all local minima must also be global. Therefore, many popular optimization algorithms such as (stochastic) gradient descent can provably solve matrix completion with \textit{arbitrary} initialization in polynomial time.
🌉
Interdisciplinary Bridge
— Data Science & Analytics and Machine Learning and Mathematics & Optimization
📈
Trend Setter
— Non-Convex Optimization
🧭
Keyword Pioneer
— local minima
🐣
Hot Topic Early Bird
— collaborative filtering
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy