"momentum methods" Papers
4 papers found
Conference
Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
Zijian Liu, Zhengyuan Zhou
ICLR 2025arXiv:2412.19529
28
citations
Double Momentum Method for Lower-Level Constrained Bilevel Optimization
Wanli Shi, Yi Chang, Bin Gu
ICML 2024arXiv:2406.17386
1
citations
MoMo: Momentum Models for Adaptive Learning Rates
Fabian Schaipp, Ruben Ohana, Michael Eickenberg et al.
ICML 2024arXiv:2305.07583
20
citations
On the Generalization of Stochastic Gradient Descent with Momentum
Ali Ramezani-Kebrya, Kimon Antonakopoulos, Volkan Cevher et al.
ICML 2024arXiv:1809.04564
36
citations