References

For more information, please refer to our paper and GitHub repository.

Paper: Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation

GitHub: BiPE

Authors: Zhenyu He*, Guhao Feng*, Shengjie Luo*, Kai Yang, Di He, Jingjing Xu, Zhi Zhang, Hongxia Yang, Liwei Wang

Downloads last month
12
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.