Popular GitHub Repositories for Batch Systems

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive AI systems.

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

? CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org

A curated list of Artificial Intelligence (AI) courses, books, video lectures and papers.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"

Build, Manage and Deploy AI/ML Systems

A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities

Curated list of Machine Learning, NLP, Vision, Recommender Systems Project Ideas

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

An open source library for deep learning end-to-end dialog systems and chatbots.

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, support 11 programming languages