"adaptive optimization" Papers
8 papers found
Conference
AdaLRS: Loss-Guided Adaptive Learning Rate Search for Efficient Foundation Model Pretraining
Hongyuan Dong, Dingkang Yang, Xiao Liang et al.
NEURIPS 2025arXiv:2506.13274
3
citations
Decoupled Entropy Minimization
Jing Ma, Hanlin Li, Xiang Xiang
NEURIPS 2025arXiv:2511.03256
Efficient Adaptive Federated Optimization
Su Hyeong Lee, Sidharth Sharma, Manzil Zaheer et al.
NEURIPS 2025arXiv:2410.18117
2
citations
Sketched Gaussian Mechanism for Private Federated Learning
Qiaobo Li, Zhijie Chen, Arindam Banerjee
NEURIPS 2025spotlightarXiv:2509.08195
1
citations
A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
Ashwinee Panda, Xinyu Tang, Saeed Mahloujifar et al.
ICML 2024arXiv:2212.04486
15
citations
FADAS: Towards Federated Adaptive Asynchronous Optimization
Yujia Wang, Shiqiang Wang, Songtao Lu et al.
ICML 2024arXiv:2407.18365
13
citations
Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise
Kwangjun Ahn, Zhiyu Zhang, Yunbum Kook et al.
ICML 2024arXiv:2402.01567
22
citations
When Will Gradient Regularization Be Harmful?
Yang Zhao, Hao Zhang, Xiuyuan Hu
ICML 2024arXiv:2406.09723
2
citations