"compute-optimal scaling" Papers
3 papers found
Conference
How to Scale Second-Order Optimization
Charlie Chen, Shikai Qiu, Hoang Phan et al.
NEURIPS 2025
A Dynamical Model of Neural Scaling Laws
Blake Bordelon, Alexander Atanasov, Cengiz Pehlevan
ICML 2024arXiv:2402.01092
77
citations
Mechanistic Design and Scaling of Hybrid Architectures
Michael Poli, Armin Thomas, Eric Nguyen et al.
ICML 2024arXiv:2403.17844
53
citations