token-optimizer

Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Design patterns implemented in Java

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Spring Boot helps you to create Spring-powered, production-grade applications and services with absolute minimum fuss.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Make websites accessible for AI agents

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)