2024 ICML ICML 2024

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise