Popular GitHub Repositories for Memory Speed

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

The Memory layer for AI Agents

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.

An open source library for face detection in images. The face detection speed can reach 1000FPS.

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

High-speed Large Language Model Serving for Local Deployment

Video-based AI memory library. Store millions of text chunks in MP4 files with lightning-fast semantic search. No database needed.

Trax — Deep Learning with Clear Code and Speed

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Alluxio, data orchestration for analytics and machine learning in the cloud

Reliable LLM Memory for AI Applications and AI Agents

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

Serverless AI Workflows for Data & ML Teams

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

? Refly is an open-source AI-native creation engine. Its intuitive free-form canvas interface combines multi-threaded dialogues, artifact, AI knowledge base integration, chrome extension clip & save, contextual memory, intelligent search, WYSIWYG AI editor and more, empowering you to effortlessly transform ideas into production-ready content.