"continued pretraining" Papers
2 papers found
Conference
LoRA Learns Less and Forgets Less
Jonathan Frankle, Jose Javier Gonzalez Ortiz, Cody Blakeney et al.
ICLR 2025arXiv:2405.09673
252
citations
MathCoder2: Better Math Reasoning from Continued Pretraining on Model-translated Mathematical Code
Zimu Lu, Aojun Zhou, Ke Wang et al.
ICLR 2025arXiv:2410.08196
28
citations