2023
ICML
ICML 2023
Distribution-dependent McDiarmid-type Inequalities for Functions of Unbounded Interaction
Abstract
The concentration of measure inequalities serves an essential role in statistics and machine learning. This paper gives unbounded analogues of the McDiarmid-type exponential inequalities for three popular classes of distributions, namely sub-Gaussian, sub-exponential and heavy-tailed distributions. The inequalities in the sub-Gaussian and sub-exponential cases are distribution-dependent compared with the recent results, and the inequalities in the heavy-tailed case are not available in the previous works. The usefulness of the inequalities is illustrated through applications to the sample mean, U-statistics and V-statistics.
🌉
Interdisciplinary Bridge
— Machine Learning and Mathematics & Optimization
🧭
Keyword Pioneer
— mcdiarmid inequality
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Machine Learning, Mathematics & Optimization, Reinforcement Learning
Authors
Topics
Machine Learning > Optimization & Theory > Statistical Learning
Mathematics & Optimization > Mathematics > Probability
Mathematics & Optimization > Mathematics > Statistics
Machine Learning > Optimization & Theory > Stochastic Methods
Machine Learning > Optimization & Theory > Statistics
Mathematics & Optimization > Probability > Stochastic Processes