← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

902 directly classified papers

Papers per year

Papers

On the Generalization Benefit of Noise in Stochastic Gradient Descent ICML 2020
Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020
Landscape Connectivity and Dropout Stability of SGD Solutions for Over-parameterized Neural Networks ICML 2020
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent ICML 2020
A Mean Field Analysis Of Deep ResNet And Beyond: Towards Provably Optimization Via Overparameterization From Depth ICML 2020
Neural Architecture Search in A Proxy Validation Loss Landscape ICML 2020
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent ICML 2020
Information-Theoretic Local Minima Characterization and Regularization ICML 2020
Evolutionary Algorithm Enhanced Neural Architecture Search for Text-Independent Speaker Verification INTERSPEECH 2020
Neural Architecture Search on Acoustic Scene Classification INTERSPEECH 2020
Neural Architecture Search for Keyword Spotting INTERSPEECH 2020
Generalization bound of globally optimal non-convex neural network training: Transportation map estimation by infinite dimensional Langevin dynamics NIPS 2020
Efficient Residual Dense Block Search for Image Super-Resolution AAAI 2020
Stochastic Loss Function AAAI 2020
Fastened CROWN: Tightened Neural Network Robustness Certificates AAAI 2020
Neural Inheritance Relation Guided One-Shot Layer Assignment Search AAAI 2020
Network as Regularization for Training Deep Neural Networks: Framework, Model and Performance AAAI 2020
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020
Architecture Search of Dynamic Cells for Semantic Video Segmentation WACV 2020
Self-Orthogonality Module: A Network Architecture Plug-in for Learning Orthogonal Filters WACV 2020
Norm-Based Curriculum Learning for Neural Machine Translation ACL 2020
Attentive Pooling with Learnable Norms for Text Representation ACL 2020
Orthogonal Gradient Descent for Continual Learning AISTATS 2020
An Empirical Study of Stochastic Gradient Descent with Structured Covariance Noise AISTATS 2020
Shallow-to-Deep Training for Neural Machine Translation EMNLP 2020