dynamic-batching

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Make websites accessible for AI agents

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

? The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

A programming framework for agentic AI ? PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

LlamaIndex is the leading framework for building LLM-powered agents over your data.