ml-management-tools

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Workflow Engine for Kubernetes

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ???

Build data pipelines, the easy way ?️

Curated list of resources about Apache Airflow

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Elyra extends JupyterLab with an AI centric approach.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.