"induction head" Papers
2 papers found
Conference
Rethinking Associative Memory Mechanism in Induction Head
Shuo Wang, Issei Sato
COLM 2025paper
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation
Aaditya Singh, Ted Moskovitz, Feilx Hill et al.
ICML 2024spotlightarXiv:2404.07129
64
citations