AIbase
Home
AI Tutorial

infini-transformer

Public

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

attention-mechanismdeep-learninginfini-attentionlong-contextmixture-of-depthspytorchtransformers
Creat：2024-04-15T17:37:36
Update：2025-03-21T11:01:17
294
Stars
0
Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
2年前
+38today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
1年前
+73today

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
2年前
+136today

30 Seconds Of Code

astro

Coding articles to level up your development skills

125990
10个月前
+35today

Pytorch

Hot
autograd

Tensors and Dynamic neural networks in Python with strong GPU acceleration

95701
10个月前
+88today

Opencv

c-plus-plus

Open Source Computer Vision Library

85202
7年前
+42today

Netdata

alerting

X-Ray Vision for your infrastructure!

76944
10个月前
+31today

Deep Live Cam

Hot
ai

real time face swap and one-click video deepfake with only a single image

76195
11个月前
+63today

D2l Zh

Hot
book

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

74277
10个月前
+60today

Cs Video Courses

Hot
algorithms

List of Computer Science courses with video lectures.

70343
10个月前
+91today