Popular GitHub Repositories for Cache

Suite of tools containing an in-memory vector datastore and AI proxy

How to serve ML predictions 100x faster

Cache PyTorch module outputs on-the-fly

RAG-Buddy: Decrease cost and lower latency for LLM apps

Jarvis v13 is a Python-based personal assistant powered by Gemini, designed to automate tasks, answer queries, and assist with creative content generation.

Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform

StocksALot is a cutting edge PoC for Stock Market Analysis employing OpenAI's GPT LLMs for insight inference.

Using Server-Sent Events (SSE) to stream LLM responses in Next.js

Identicon generator for Intersystems Caché. Good to use in Mojo applications.

The project is focused on parallelising pre-processing, measuring and machine learning in the cloud, as well as the evaluation and analysis of the cloud performance.

BestByBuddy is an API backend designed to help users manage their grocery purchases efficiently, reduce food wastage, and save money. The API processes images of groceries using GPT-4 to identify perishables and estimate their expiry dates ensuring they consume products before they go bad and cut down on unnecessary waste.

Providing async thread-safe singleton Semantic Kernel instances