stripe-etl

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Workflow Engine for Kubernetes

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Build data pipelines, the easy way ?️

Curated list of resources about Apache Airflow

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.