llm-inference

Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Make websites accessible for AI agents

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

? The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

A programming framework for agentic AI ? PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour