Popular GitHub Repositories for Dataset Pipeline

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.

Cross-platform, customizable ML solutions for live and streaming media.

?? Build multimodal AI applications with cloud-native stack

Turns Data and AI algorithms into production-ready web applications in no time.

[CVPR2023] Blur Interpolation Transformer for Real-World Motion from Blur

pix2tex: Using a ViT to convert images of equations into LaTeX code.

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

A powerful tool for creating fine-tuning datasets for LLM

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Open source annotation tool for machine learning practitioners.

Techniques for deep learning with satellite & aerial imagery

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Curated list of Machine Learning, NLP, Vision, Recommender Systems Project Ideas

A Collection of Variational Autoencoders (VAE) in PyTorch.

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution