"optimization algorithms" Papers
14 papers found
Conference
ADAM Optimization with Adaptive Batch Selection
Gyu Yeol Kim, Min-hwan Oh
ICLR 2025arXiv:2512.06795
2
citations
Balancing Gradient and Hessian Queries in Non-Convex Optimization
Deeksha Adil, Brian Bullins, Aaron Sidford et al.
NEURIPS 2025arXiv:2510.20786
1
citations
Data-Driven Performance Guarantees for Classical and Learned Optimizers
Rajiv Sambharya, Bartolomeo Stellato
NEURIPS 2025arXiv:2404.13831
10
citations
Deconstructing What Makes a Good Optimizer for Autoregressive Language Models
Rosie Zhao, Depen Morwani, David Brandfonbrener et al.
ICLR 2025
37
citations
Descent with Misaligned Gradients and Applications to Hidden Convexity
Aditya Bhaskara, Ashok Cutkosky, Ravi Kumar et al.
ICLR 2025
From Promise to Practice: Realizing High-performance Decentralized Training
Zesen Wang, Jiaojiao Zhang, Xuyang Wu et al.
ICLR 2025arXiv:2410.11998
3
citations
Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
Qiang Fu, Andre Wibisono
NEURIPS 2025spotlightarXiv:2505.12553
2
citations
How Memory in Optimization Algorithms Implicitly Modifies the Loss
Matias Cattaneo, Boris Shigida
NEURIPS 2025arXiv:2502.02132
2
citations
Some Optimizers are More Equal: Understanding the Role of Optimizers in Group Fairness
Mojtaba Kolahdouzi, Hatice Gunes, Ali Etemad
NEURIPS 2025spotlightarXiv:2504.14882
A Universal Class of Sharpness-Aware Minimization Algorithms
Behrooz Tahmasebi, Ashkan Soleymani, Dara Bahri et al.
ICML 2024arXiv:2406.03682
12
citations
DP-AdamBC: Your DP-Adam Is Actually DP-SGD (Unless You Apply Bias Correction)
Qiaoyue Tang, Frederick Shpilevskiy, Mathias Lécuyer
AAAI 2024paperarXiv:2312.14334
30
citations
How to Escape Sharp Minima with Random Perturbations
Kwangjun Ahn, Ali Jadbabaie, Suvrit Sra
ICML 2024arXiv:2305.15659
14
citations
On the Implicit Bias of Adam
Matias Cattaneo, Jason Klusowski, Boris Shigida
ICML 2024arXiv:2309.00079
24
citations
Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens
Ross Clarke, Jose Miguel Hernandez-Lobato
ICML 2024arXiv:2310.14963
2
citations