"model expressivity" Papers
3 papers found
Conference
Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning
Arian Raje, Baris Askin, Divyansh Jhunjhunwala et al.
NEURIPS 2025arXiv:2506.05568
3
citations
A Tensor Decomposition Perspective on Second-order RNNs
Maude Lizaire, Michael Rizvi-Martel, Marawan Gamal et al.
ICML 2024spotlightarXiv:2406.05045
2
citations
Self-attention Networks Localize When QK-eigenspectrum Concentrates
Han Bao, Ryuichiro Hataya, Ryo Karakida
ICML 2024arXiv:2402.02098
11
citations