Popular GitHub Repositories for Memory Optimization

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

The Memory layer for AI Agents

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!

A hyperparameter optimization framework

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

Simple Reinforcement learning tutorials, 莫烦Python 中文AI教学

Fast and Accurate ML in 3 Lines of Code

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Video-based AI memory library. Store millions of text chunks in MP4 files with lightning-fast semantic search. No database needed.