← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

902 directly classified papers

Papers per year

Papers

Follow the Moving Leader in Deep Learning ICML 2017
meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting ICML 2017
Natasha: Faster Non-Convex Stochastic Optimization via Strongly Non-Convex Parameter ICML 2017
Preventing Gradient Explosions in Gated Recurrent Units NIPS 2017
Learning ReLUs via Gradient Descent NIPS 2017
Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models NIPS 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks NIPS 2017
Less than a Single Pass: Stochastically Controlled Stochastic Gradient AISTATS 2017
Sobolev Training for Neural Networks NIPS 2017
Convergent Block Coordinate Descent for Training Tikhonov Regularized Deep Neural Networks NIPS 2017
Accelerated Doubly Stochastic Gradient Algorithm for Large-scale Empirical Risk Minimization IJCAI 2017
Input-to-Output Gate to Improve RNN Language Models IJCNLP 2017
Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samples NIPS 2017
Optimal Rates for Multi-pass Stochastic Gradient Methods JMLR 2017
Learning Adaptive Receptive Fields for Deep Image Parsing Network CVPR 2017
Improving Training of Deep Neural Networks via Singular Value Bounding CVPR 2017
Generalization Properties and Implicit Regularization for Multiple Passes SGM ICML 2016
Network Morphism ICML 2016
Asynchronous Parallel Learning for Neural Networks and Structured Models with Dense Features COLING 2016
Deep Residual Learning for Image Recognition CVPR 2016
Optimal Architectures in a Solvable Model of Deep Networks NIPS 2016
Learning Sparse High Dimensional Filters: Image Filtering, Dense CRFs and Bilateral Neural Networks CVPR 2016
HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection CVPR 2016
Refining Architectures of Deep Convolutional Neural Networks CVPR 2016
Fast Algorithms for Convolutional Neural Networks CVPR 2016