Popular GitHub Repositories for Open Source Llm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

LLM (Large Language Model) FineTuning

LLMs and Machine Learning done easily

A list of LLMs Tools & Projects

This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexities of LLM technology and the desire for an accessible and customizable AI experience.

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Samples on how to build industry solution leveraging generative AI capabilities on top of SAP BTP and integrated with SAP S/4HANA Cloud.

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

Fine-tune open-source Language Models (LLMs) on E-commerce data, leveraging Amazon's sales data. Showcase a tailored solution for enhanced language understanding and generation with a focus on custom E-commerce datasets.

Multi-agent workflows with Llama3: A private on-device multi-agent framework

LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.

In this project, we leverage Weaviate, a vector database, to power our retrieval-augmented generation (RAG) application. Weaviate enables efficient vector similarity search, which is crucial for building effective RAG systems. Additionally, we use local language model (LLM) and embedding models.

这个项目使用LangChain、Groq的LLaMA 3模型、ChromaDB和HuggingFace嵌入技术，实现了一个可用于生产环境的对话式（RAG）聊天机器人。它利用RunnableWithMessageHistory支持跨会话的持久化聊天记录，并集成了模块化提示、文档加载和检索感知链，从而处理上下文感知的多轮对话。