Popular GitHub Repositories for Massive

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

MTEB: Massive Text Embedding Benchmark

Interact, analyze and structure massive text, image, embedding, audio and video datasets

MCP server that enables AI assistants to interact with Google Gemini CLI, leveraging Gemini's massive token window for large file analysis and codebase understanding

Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massive Transpose extrapolation problem in onnx-tensorflow (onnx-tf). I don't need a Star, but give me a pull request.

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

A script for credentials-based attack surface enumeration and general reconnaissance of massive networks

WhiteLightning distills massive, state-of-the-art language models into lightweight, hyper-efficient text classifiers. It's a command-line tool that lets you create specialized models that run anywhere—from the cloud to the edge—using the universal ONNX format for maximum compatibility.

This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

Massive open Japanese speech corpus

Blueprint for Ingesting massive volumes of live or archived videos and extract insights for summarization and interactive Q&A

Code accompanying the paper "Massive Activations in Large Language Models"

100 Days Of Machine Learning. New Content in every 1-2 day and projects every week. The massive 100DaysOfML in building

Graph meta learning via local subgraphs (NeurIPS 2020)

Accelerated Training for Massive Classification via Dynamic Class Selection (AAAI 2018, Oral)

Channel Estimation for One-Bit Multiuser Massive MIMO Using Conditional GAN