← Optimization & Theory
Machine Learning › Optimization & Theory ›

Information Theory

313 directly classified papers

Papers per year

Papers

Parametric Information Maximization for Generalized Category Discovery ICCV 2023
JacobiNeRF: NeRF Shaping With Mutual Information Gradients CVPR 2023
FACE: Evaluating Natural Language Generation with Fourier Analysis of Cross-Entropy NIPS 2023
An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech INTERSPEECH 2023
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels JMLR 2023
Communication-Constrained Bandits under Additive Gaussian Noise ICML 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples ICML 2023
On Slicing Optimality for Mutual Information NIPS 2023
How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm? AISTATS 2023
Label Information Bottleneck for Label Enhancement CVPR 2023
DIET: Conditional independence testing with marginal dependence measures of residual information AISTATS 2023
Towards Stable Natural Language Understanding via Information Entropy Guided Debiasing ACL 2023
Fundamental Tradeoffs in Learning with Prior Information ICML 2023
Prediction-Oriented Bayesian Active Learning AISTATS 2023
Enhancing Multiple Reliability Measures via Nuisance-Extended Information Bottleneck CVPR 2023
Norm of Word Embedding Encodes Information Gain EMNLP 2023
Tokenization and the Noiseless Channel ACL 2023
Using Sliced Mutual Information to Study Memorization and Generalization in Deep Neural Networks AISTATS 2023
Towards Informative Few-Shot Prompt with Maximum Information Gain for In-Context Learning EMNLP 2023
An Information-Theoretic Analysis of Nonstationary Bandit Learning ICML 2023
Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training EMNLP 2023
Measuring Pointwise 𝒱-Usable Information In-Context-ly EMNLP 2023
Recognizable Information Bottleneck IJCAI 2023
Revisiting Entropy Rate Constancy in Text EMNLP 2023
An Information Theory Perspective on Variance-Invariance-Covariance Regularization NIPS 2023