2014
NIPS
NeurIPS 2014
Quantized Estimation of Gaussian Sequence Models in Euclidean Balls
Abstract
A central result in statistical theory is Pinsker's theorem, which characterizes the minimax rate in the normal means model of nonparametric estimation. In this paper, we present an extension to Pinsker's theorem where estimation is carried out under storage or communication constraints. In particular, we place limits on the number of bits used to encode an estimator, and analyze the excess risk in terms of this constraint, the signal size, and the noise level. We give sharp upper and lower bounds for the case of a Euclidean ball, which establishes the Pareto-optimal minimax tradeoff between storage and risk in this setting.
🌉
Interdisciplinary Bridge
— Machine Learning and Mathematics & Optimization
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy
📈
Trend Setter
— Statistics
🧭
Keyword Pioneer
— gaussian sequence model
🐣
Hot Topic Early Bird
— information theory
Authors
Topics
Machine Learning > Optimization & Theory > Learning Theory
Machine Learning > Optimization & Theory > Statistical Learning
Mathematics & Optimization > Mathematics > Information Theory
Mathematics & Optimization > Mathematics > Statistics
Machine Learning > Optimization & Theory > Information Theory
Mathematics & Optimization > Statistics
Machine Learning > Optimization & Theory > Statistics
Mathematics & Optimization > Statistics > Statistics