Popular GitHub Repositories for Datasets Preprocessing

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

pix2code: Generating Code from a Graphical User Interface Screenshot

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Open source annotation tool for machine learning practitioners.

A powerful tool for creating fine-tuning datasets for LLM

Refine high-quality datasets and visual AI models

Techniques for deep learning with satellite & aerial imagery

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

Visualizations for machine learning datasets

A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning

AI Observability & Evaluation

(CGCSTCD'2017) An easy, flexible, and accurate plate recognition project for Chinese licenses in unconstrained situations. CGCSTCD = China Graduate Contest on Smart-city Technology and Creative Design

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

搜索所有中文NLP数据集，附常用英文NLP数据集