LangRoute

Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Make websites accessible for AI agents

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

The Cloud Native Application Proxy