AIbase
Home

flash-tokenizer

Public

EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

Creat：2025-03-09T08:26:27
Update：2025-04-04T18:08:53
https://github.com/NLPOptimize/flash-tokenizer
466
Stars
2
Stars Increase

Related projects

Build Your Own X

Hot
awesome-list

Master programming by recreating your favorite technologies from scratch.

447517
1年前
+1027today

Awesome

Hot
awesome

? Awesome lists about all kinds of interesting topics

421069
1年前
+873today

Awesome Selfhosted

Hot
awesome

A list of Free Software network services and web applications which can be hosted on your own servers

262124
1年前
+568today

Computer Science

Hot
awesome-list

? Path to a free self-taught education in Computer Science!

198852
1年前
+153today

The Book Of Secret Knowledge

Hot
awesome

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools and more.

197268
1年前
+457today

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
3年前
+38today

AutoGPT

Hot
ai

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

180179
1年前
+59today

N8n

Hot
ai

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

161403
5年前
+680today

Awesome Go

Hot
awesome

A curated list of awesome Go frameworks, libraries and software

159484
1年前
+279today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
2年前
+73today