llm-serving-benchmark

Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Make websites accessible for AI agents

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

? The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

A programming framework for agentic AI ? PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.