Popular GitHub Repositories for Huggingface Pipeline

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Cross-platform, customizable ML solutions for live and streaming media.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

This repository contains the Hugging Face Agents Course.

?? Build multimodal AI applications with cloud-native stack

Turns Data and AI algorithms into production-ready web applications in no time.

FinGPT: Open-Source Financial Large Language Models! Revolutionize ? We release the trained model on HuggingFace.

This repository contains demos I made with the Transformers library by HuggingFace.

A PyTorch-based Speech Toolkit

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Java version of LangChain

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

A scikit-learn compatible neural network library that wraps PyTorch

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai