← Optimization & Theory
Deep Learning › Optimization & Theory ›

Stochastic Methods

97 directly classified papers

Papers per year

Papers

Chaotic Regularization and Heavy-Tailed Limits for Deterministic Gradient Descent NIPS 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit NIPS 2022
On the Theoretical Properties of Noise Correlation in Stochastic Optimization NIPS 2022
Fast Mixing of Stochastic Gradient Descent with Normalization and Weight Decay NIPS 2022
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms NIPS 2022
The alignment property of SGD noise and how it helps select flat minima: A stability analysis NIPS 2022
Three Operator Splitting with Subgradients, Stochastic Gradients, and Adaptive Learning Rates NIPS 2021
Differential Privacy Dynamics of Langevin Diffusion and Noisy Gradient Descent NIPS 2021
Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGD NIPS 2021
Communication Efficient SGD via Gradient Sampling With Bayes Prior CVPR 2021
Efficient and Accurate Gradients for Neural SDEs NIPS 2021
Fast and Memory Efficient Differentially Private-SGD via JL Projections NIPS 2021
Conditional Poisson Stochastic Beams EMNLP 2021
How Emotionally Stable is ALBERT? Testing Robustness with Stochastic Weight Averaging on a Sentiment Analysis Task EMNLP 2021
ErrorCompensatedX: error compensation for variance reduced algorithms NIPS 2021
ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization AAAI 2021
Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization AAAI 2021
Deterministic Mini-batch Sequencing for Training Deep Neural Networks AAAI 2021
Online stochastic gradient descent on non-convex losses from high-dimensional inference JMLR 2021
Convergence of adaptive algorithms for constrained weakly convex optimization NIPS 2021
How far can we get with one GPU in 100 hours? CoAStaL at MultiIndicMT Shared Task ACL 2021
AC-GC: Lossy Activation Compression with Guaranteed Convergence NIPS 2021
Stochastic Anderson Mixing for Nonconvex Stochastic Optimization NIPS 2021
Deep Reservoir Computing Meets 5G MIMO-OFDM Systems in Symbol Detection AAAI 2020
Amortized variance reduction for doubly stochastic objective UAI 2020