← Optimization & Theory
Deep Learning › Optimization & Theory ›

Theory

1072 directly classified papers

Papers per year

Papers

On the Optimal Weighted $\ell_2$ Regularization in Overparameterized Linear Regression NIPS 2020
Neural Complexity Measures NIPS 2020
Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification NIPS 2020
Neural Networks Learning and Memorization with (almost) no Over-Parameterization NIPS 2020
Certified Defense to Image Transformations via Randomized Smoothing NIPS 2020
Overfitting Can Be Harmless for Basis Pursuit, But Only to a Degree NIPS 2020
Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study NIPS 2020
Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks NIPS 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains NIPS 2020
Hierarchical nucleation in deep neural networks NIPS 2020
Exactly Computing the Local Lipschitz Constant of ReLU Networks NIPS 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks NIPS 2020
On Correctness of Automatic Differentiation for Non-Differentiable Functions NIPS 2020
Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel NIPS 2020
Language Through a Prism: A Spectral Approach for Multiscale Language Representations NIPS 2020
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020
Information-Theoretic Local Minima Characterization and Regularization ICML 2020
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders ICML 2020
Efficient Proximal Mapping of the 1-path-norm of Shallow Networks ICML 2020
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent ICML 2020
Transformation of ReLU-based recurrent neural networks from discrete-time to continuous-time ICML 2020
Capacity Control of ReLU Neural Networks by Basis-Path Norm AAAI 2019
Spurious Valleys in One-hidden-layer Neural Network Optimization Landscapes JMLR 2019
Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery JMLR 2019
Convergence of Gradient Descent on Separable Data AISTATS 2019