Popular GitHub Repositories for Batch Operations

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Production-ready Claude subagents collection with 77+ specialized AI agents for full-stack development, DevOps, data science, and business operations.

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Python library for Modzy Machine Learning Operations (MLOps) Platform

A collection of production-ready Generative AI Agent templates built for Google Cloud. It accelerates development by providing a holistic, production-ready solution, addressing common challenges (Deployment & Operations, Evaluation, Customization, Observability) in building and deploying GenAI agents.

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！?

一键生成产品营销与泛内容短视频，AI批量自动剪辑，高颜值跨平台桌面端工具 One click generation of product marketing and general content short videos, AI batch automatic cliping, beautiful cross platform desktop tool

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

Awesome machine learning for combinatorial optimization papers.

The open source Solver AI for Java, Python and Kotlin to optimize scheduling and routing. Solve the vehicle routing problem, employee rostering, task assignment, maintenance scheduling and other planning problems.

Gp.nvim (GPT prompt) Neovim AI plugin: ChatGPT sessions & Instructable text/code operations & Speech to text [OpenAI, Ollama, Anthropic, ..]

Application implementation with business use cases for safely utilizing generative AI in business operations

PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

? ??? ???? ????? ?-????? ????? ????????? | ????? ??? & ????? for free by designing, building and deploying an end-to-end ML batch system ~ ?????? ???? + 2.5 ????? ?? ??????? & ????? ?????????

Library for specialized dense and sparse matrix operations, and deep learning primitives.