Popular GitHub Repositories for Large Data

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

Deep Learning for humans

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

? Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Drag & drop UI to build your customized LLM flow

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Build and share delightful machine learning apps, all in Python. ? Star to support our work!

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

AI's query engine - Platform for building AI that can learn and answer questions over large scale federated data.

Collection of various algorithms in mathematics, machine learning, computer science and physics implemented in C++ for educational purposes.

? Industrial-strength Natural Language Processing (NLP) in Python

Easily train a good VC model with voice data <= 10 mins!