Popular GitHub Repositories for Batch Analytics

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

? Rybbit - open-source and privacy-friendly alternative to Google Analytics that is 10x more intuitive.

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

A collection of libraries to optimise AI model performances

Alluxio, data orchestration for analytics and machine learning in the cloud

Tracking the impact of COVID-19 in India

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Flower: A Friendly Federated AI Framework

A code-first agent framework for seamlessly planning and executing data analytics tasks.

Real-time Claude Code usage monitor with predictions and warnings

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

? Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ?

Cool experiments at the intersection of Computer Vision and Sports ??

XIAOJUSURVEY is an enterprises form builder and analytics platform that allows users to create questionnaires, exams, polls, quizzes, and analyze data online.

? ? ? ? GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.