Popular GitHub Repositories for Massive Datasets

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习

pix2code: Generating Code from a Graphical User Interface Screenshot

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Open source annotation tool for machine learning practitioners.

A powerful tool for creating fine-tuning datasets for LLM

Refine high-quality datasets and visual AI models

Techniques for deep learning with satellite & aerial imagery

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

Visualizations for machine learning datasets

A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning

AI Observability & Evaluation

(CGCSTCD'2017) An easy, flexible, and accurate plate recognition project for Chinese licenses in unconstrained situations. CGCSTCD = China Graduate Contest on Smart-city Technology and Creative Design

Codes and datasets for NeurIPS21 paper “Towards Open-World Feature Extrapolation: An Inductive Graph Learning Approach”