← Optimization & Theory
Deep Learning › Optimization & Theory ›

Theory

1072 directly classified papers

Papers per year

Papers

CNN-Cert: An Efficient Framework for Certifying Robustness of Convolutional Neural Networks AAAI 2019
Transformer Dissection: An Unified Understanding for Transformer’s Attention via the Lens of Kernel EMNLP 2019
Energy and Policy Considerations for Deep Learning in NLP ACL 2019
RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications AAAI 2019
Universal Approximation Property and Equivalence of Stochastic Computing-Based Neural Networks and Binary Neural Networks AAAI 2019
Weisfeiler and Leman Go Neural: Higher-Order Graph Neural Networks AAAI 2019
Global Robustness Evaluation of Deep Neural Networks with Provable Guarantees for the Hamming Distance IJCAI 2019
Adversarial Examples Are a Natural Consequence of Test Error in Noise ICML 2019
Width Provably Matters in Optimization for Deep Linear Neural Networks ICML 2019
What is the Effect of Importance Weighting in Deep Learning? ICML 2019
Unreproducible Research is Reproducible ICML 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks ICML 2019
A Convergence Theory for Deep Learning via Over-Parameterization ICML 2019
Which Neural Net Architectures Give Rise to Exploding and Vanishing Gradients? NIPS 2018
The Spectrum of the Fisher Information Matrix of a Single-Hidden-Layer Neural Network NIPS 2018
Local Identifiability of $\ell_1$-minimization Dictionary Learning: a Sufficient and Almost Necessary Condition JMLR 2018
The Implicit Bias of Gradient Descent on Separable Data JMLR 2018
Self-Normalization Properties of Language Modeling COLING 2018
Smoothed analysis of the low-rank approach for smooth semidefinite programs NIPS 2018
On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport NIPS 2018
A Convex Duality Framework for GANs NIPS 2018
Understanding Generalization and Optimization Performance of Deep CNNs ICML 2018
A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based Visualizations ICML 2018
Optimization Landscape and Expressivity of Deep CNNs ICML 2018
Bounds on the Approximation Power of Feedforward Neural Networks ICML 2018