Popular GitHub Repositories for Cache Storage

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Firebase SDK for Apple App Development

Supercharge Your LLM with the Fastest KV Cache Layer

Scalable Multi-modal RAG platform

C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types and contiguous memory storage

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms.

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

Unified KV Cache Compression Methods for Auto-Regressive Models

? Tiny S3 client. Edge computing ready. No-dep. In Typescript. Works with @cloudflare @minio @backblaze @digitalocean @garagehq

A Generative Art Generator

R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on Kubernetes

An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.

Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.

Raspberry PI-TIMOLO ( PI-TImelapse, MOtion, LOwLight ) uses RPI picamera and OpenCV for Remote Headless Security Monitoring using Motion Tracking, Rclone Auto Sync files with remote storage services. Auto Twilight Transitions and Low Light Camera Settings. Panoramic images using PanTiltHat and More. This project is featured on GitHub Awesome software.