2019
NIPS
NeurIPS 2019
A General Framework for Symmetric Property Estimation
Abstract
In this paper we provide a general framework for estimating symmetric properties of distributions from i.i.d. samples. For a broad class of symmetric properties we identify the {\em easy} region where empirical estimation works and the {\em difficult} region where more complex estimators are required. We show that by approximately computing the profile maximum likelihood (PML) distribution \cite{ADOS16} in this difficult region we obtain a symmetric property estimation framework that is sample complexity optimal for many properties in a broader parameter regime than previous universal estimation approaches based on PML. The resulting algorithms based on these \emph{pseudo PML distributions} are also more practical.
🌉
Interdisciplinary Bridge
— Machine Learning and Mathematics & Optimization
📈
Trend Setter
— Sample Complexity
🧭
Keyword Pioneer
— symmetric property estimation
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio
Authors
Topics
Machine Learning > Optimization & Theory > Statistical Learning
Mathematics & Optimization > Mathematics > Probability
Mathematics & Optimization > Mathematics > Statistics
Mathematics & Optimization > Statistics > Statistics
Machine Learning > Optimization & Theory > Sample Complexity
Machine Learning > Core Methods > Sampling