"relative positional encodings" Papers
3 papers found
Conference
Eliminating Position Bias of Language Models: A Mechanistic Approach
Ziqi Wang, Hanlin Zhang, Xiner Li et al.
ICLR 2025arXiv:2407.01100
50
citations
Comparing Graph Transformers via Positional Encodings
Mitchell Black, Zhengchao Wan, Gal Mishne et al.
ICML 2024arXiv:2402.14202
24
citations
Exploring Transformer Extrapolation
Zhen Qin, Yiran Zhong, Hui Deng
AAAI 2024paperarXiv:2307.10156
12
citations