Popular GitHub Repositories for Quality Metrics

Learn how to design, develop, deploy and iterate on production-grade ML applications.

? Papers & tech blogs by companies sharing their work on data science & machine learning in production.

Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

PyTorch implementation of the U-Net for image semantic segmentation with high quality images

Refine high-quality datasets and visual AI models

The LLM Evaluation Framework

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

The Open Source Feature Store for AI/ML

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

Pre-trained Deep Learning models and demos (high quality and extremely fast)