Popular GitHub Repositories for Memory Efficient

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

? Empowering everyone to build reliable and efficient smart contracts.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Memory layer for AI Agents

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

??HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

? 卡卡字幕助手 | VideoCaptioner - 基于 LLM 的智能字幕助手 - 视频字幕生成、断句、校正、字幕翻译全流程处理！- A powered tool for easy and efficient video subtitling.

Video-based AI memory library. Store millions of text chunks in MP4 files with lightning-fast semantic search. No database needed.

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Alluxio, data orchestration for analytics and machine learning in the cloud

Reliable LLM Memory for AI Applications and AI Agents

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.