"adaptive optimization methods" Papers
2 papers found
Conference
Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise
Enea Monzio Compagnoni, Tianlin Liu, Rustem Islamov et al.
ICLR 2025arXiv:2411.15958
17
citations
Prodigy: An Expeditiously Adaptive Parameter-Free Learner
Konstantin Mishchenko, Aaron Defazio
ICML 2024arXiv:2306.06101
113
citations