LongRoPE
PublicImplementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
aiartificial-intelligenceattention-is-all-you-needattention-mechanismsdeep-learninggptlanguage-modelllmmachine-learningnatural
Creat:2024-03-06T14:30:54
Update:2025-03-24T11:42:49
https://arxiv.org/pdf/2402.13753.pdf
148
Stars
0
Stars Increase