llm-offline-inference

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Make websites accessible for AI agents

? The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Opiniated RAG for integrating GenAI in your apps ? Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

?? Turn any webpage into a desktop app with Rust. ?? 利用 Rust 轻松构建轻量级多端桌面应用