Popular GitHub Repositories for Litellm

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Evaluate your LLM's response with Prometheus and GPT4 ?

Lightweight LLM Interaction Framework

An example agent demonstrating streaming, tool use, and interactivity from your terminal. This agent builder can help you to build your own agents and tools.

Open-Source RAG app with LLM Observability (Langfuse), support for 100+ providers (LiteLLM), Dockerized, Full Type-checking, 100% Test coverage, and more...

VividNode: Multi-purpose Text & Image Generation Desktop Chatbot (supporting various models including GPT).

JavaScript implementation of LiteLLM.

To simplify and streamline LLM operations, empowering developers and organizations to harness the full potential of large language models with ease.

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

Template for a new generative ai project using uv, streamlit, fastapi, llms (cloud & local with litellm and ollama) and langfuse for llm observability

A Discord bot for large language models. Add Gemini, Llama 3.3, DeepSeek R-1, and other models.

Power up your data science workflow with ChatGPT.

? LiteLLM Proxy for Google Cloud Generative AI

Sales AI agent that talks with your customers, recommend products, book consultations, and process Stripe payments

LangChain + LiteLLM that works

SynthGenAI - Package for Generating Synthetic Datasets using LLMs.

LocalAPI.AI is a local AI management tool for Ollama, offering Web UI management and compatibility with vLLM, LM Studio, llama.cpp, Mozilla-Llamafile, Jan Al, Cortex API, Local-LLM, LiteLLM, GPT4All, and more.

Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Human-in-the-loop integration.

Prompt templating and versioning using jinja2 and litellm ?

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.