Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation

Zhenyu He , Guhao Feng , Shengjie Luo , Kai Yang , Liwei Wang , Jingjing Xu , Zhi Zhang , Hongxia Yang , Di He