Popular GitHub Repositories for Caching

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

An open-source runtime for composable workflows. Great for AI agents and CI/CD.

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

In-memory vector store with efficient read and write performance for semantic caching and retrieval system. Redis for Semantic Caching.

Context parallel attention that accelerates DiT model inference with dynamic caching

A modern, lightweight, and customizable C# Discord library with Native AOT support, immutable caching, voice capabilities, and complete API coverage.

? DiscovAI-Search: An AI-powered search engine for AI tools and custom data. Built with Next.js, OpenAI, Supabase, and more. Features vector-based search, Redis caching, and LLM-powered responses.

API 200 is an open source API gateway to simplify 3rd-party integrations. Import endpoints, set up caching, retries, and mocks. Access all services via one URL. Monitor logs, track errors, and get alerts on API incidents.

?A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. ??

The Multi-Agent Reasoning framework creates an interactive chatbot where AI agents collaborate via structured reasoning and Swarm Integration for optimal answers. Simulating a team that discusses, debates, and refines responses, it enables complex problem-solving and precise results. Now with Prompt Caching to reduce latency and costs.

Anthropic Claude API wrapper for Go

? Prevents outdated Rust code suggestions from AI assistants. This MCP server fetches current crate docs, uses embeddings/LLMs, and provides accurate context via a tool call.

lipsync is a simple and updated Python library for lip synchronization, based on Wav2Lip. It synchronizes lips in videos and images based on provided audio, supports CPU/CUDA, and uses caching for faster processing.

Implementation of Trajectory Transformer with attention caching and batched beam search

A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.

Semantic caching layer for your LLM applications. Reuse responses and reduce token usage.

caching proxy for OpenAI API, deployable as a Cloudflare Worker

Deep reinforcement learning-based replacement strategy for content caching.

? MCP server that lets you search and access Svelte documentation with built-in caching

Build production ready apps for GPT using Node.js & TypeScript