AIbase
Home
AI Tutorial

megabyte

Public

A PyTorch implementation of MEGABYTE. This multi-scale transformer architecture has the excellent features of tokenization-free and sub-quadratic attention. The paper link: https://arxiv.org/abs/2305.07185

deep-learninglanguage-modelsub-quadratic-attentiontokenization-free
Creat：2023-06-01T22:08:51
Update：2025-03-20T09:25:42
10
Stars
0
Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
2年前
+38today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
1年前
+73today

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
2年前
+136today

30 Seconds Of Code

astro

Coding articles to level up your development skills

125990
10个月前
+35today

Rust

Hot
compiler

Empowering everyone to build reliable and efficient software.

108357
10个月前
+91today

TypeScript

Hot
javascript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

107029
10个月前
+53today

Generative Ai For Beginners

Hot
ai

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

102828
11个月前
+172today

Pytorch

Hot
autograd

Tensors and Dynamic neural networks in Python with strong GPU acceleration

95701
10个月前
+88today

Opencv

c-plus-plus

Open Source Computer Vision Library

85202
7年前
+42today

LLMs From Scratch

Hot
ai

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

80697
1年前
+221today