← Optimization & Theory
Deep Learning › Optimization & Theory ›

Theory

1072 directly classified papers

Papers per year

Papers

Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models NIPS 2024
Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit NIPS 2024
Model Collapse Demystified: The Case of Regression NIPS 2024
Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning NIPS 2024
Graph Neural Networks Do Not Always Oversmooth NIPS 2024
Unveiling Linguistic Regions in Large Language Models ACL 2024
Polyhedral Complex Derivation from Piecewise Trilinear Networks NIPS 2024
Gradients of Functions of Large Matrices NIPS 2024
Scaling Laws in Linear Regression: Compute, Parameters, and Data NIPS 2024
UMB: Understanding Model Behavior for Open-World Object Detection NIPS 2024
Benign overfitting in leaky ReLU networks with moderate input dimension NIPS 2024
Topological obstruction to the training of shallow ReLU neural networks NIPS 2024
Does Large Language Model Contain Task-Specific Neurons? EMNLP 2024
Overparametrized Multi-layer Neural Networks: Uniform Concentration of Neural Tangent Kernel and Convergence of Stochastic Gradient Descent JMLR 2024
Detection and Measurement of Syntactic Templates in Generated Text EMNLP 2024
On the Sparsity of the Strong Lottery Ticket Hypothesis NIPS 2024
Global Convergence in Training Large-Scale Transformers NIPS 2024
Generalization and Stability of Interpolating Neural Networks with Minimal Width JMLR 2024
Input Margins Can Predict Generalization Too AAAI 2024
The effect of Leaky ReLUs on the training and generalization of overparameterized networks AISTATS 2024
Double-Descent Curves in Neural Networks: A New Perspective Using Gaussian Processes AAAI 2024
Separation and Bias of Deep Equilibrium Models on Expressivity and Learning Dynamics NIPS 2024
Exponent Relaxation of Polynomial Zonotopes and Its Applications in Formal Neural Network Verification AAAI 2024
Improved Sample Complexity Bounds for Diffusion Model Training NIPS 2024
An Analytic Solution to Covariance Propagation in Neural Networks AISTATS 2024