"gradient sparsification" Papers
4 papers found
Conference
Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixtures
Dang Nguyen, Wenhan Yang, Rathul Anand et al.
ICLR 2025arXiv:2407.19580
7
citations
Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation
Nairouz Mrabah, Nicolas Richet, Ismail Ayed et al.
ICCV 2025arXiv:2504.12436
Achieving Lossless Gradient Sparsification via Mapping to Alternative Space in Federated Learning
Do-Yeon Kim, Dong-Jun Han, Jun Seo et al.
ICML 2024
Error Feedback Can Accurately Compress Preconditioners
Ionut-Vlad Modoranu, Aleksei Kalinov, Eldar Kurtic et al.
ICML 2024arXiv:2306.06098
6
citations