InfiniGPT
PublicThis is an unofficial Pytorch implementation of the Infini Attention mechanism introduced in the paper : "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention". Note that the official code for the paper has not been released yet. In case of issues, add a PR (add an explanation of the changes made and why so?)
Creat:2024-06-19T20:34:22
Update:2025-01-06T18:16:41
https://paperswithcode.com/paper/leave-no-context-behind-efficient-infinite
4
Stars
0
Stars Increase