← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

902 directly classified papers

Papers per year

Papers

HyperAdam: A Learnable Task-Adaptive Adam for Network Training AAAI 2019
Complex Unitary Recurrent Neural Networks Using Scaled Cayley Transform AAAI 2019
Optimizing a Speaker Embedding Extractor Through Backend-Driven Regularization INTERSPEECH 2019
Whether to Pretrain DNN or not?: An Empirical Analysis for Voice Conversion INTERSPEECH 2019
Generalized Batch Normalization: Towards Accelerating Deep Neural Networks AAAI 2019
Weighted Channel Dropout for Regularization of Deep Convolutional Neural Network AAAI 2019
Transductive Auxiliary Task Self-Training for Neural Multi-Task Models EMNLP 2019
The Goldilocks Zone: Towards Better Understanding of Neural Network Loss Landscapes AAAI 2019
Guided Dropout AAAI 2019
Revisit Batch Normalization: New Understanding and Refinement via Composition Optimization AISTATS 2019
Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation EMNLP 2019
Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019
A Meta-Learning Approach for Custom Model Training AAAI 2019
Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019
Capacity Control of ReLU Neural Networks by Basis-Path Norm AAAI 2019
Inter-Class Angular Loss for Convolutional Neural Networks AAAI 2019
Learning Anytime Predictions in Neural Networks via Adaptive Loss Balancing AAAI 2019
XNAS: Neural Architecture Search with Expert Advice NIPS 2019
Asymmetric Valleys: Beyond Sharp and Flat Local Minima NIPS 2019
On the Convergence Rate of Training Recurrent Neural Networks NIPS 2019
Ouroboros: On Accelerating Training of Transformer-Based Language Models NIPS 2019
Reducing the variance in online optimization by transporting past gradients NIPS 2019
A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off NIPS 2019
Understanding the Role of Momentum in Stochastic Gradient Methods NIPS 2019
SpiderBoost and Momentum: Faster Variance Reduction Algorithms NIPS 2019