time-series-airflow-kafka-spark

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Workflow Engine for Kubernetes

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Build data pipelines, the easy way ?️

Curated list of resources about Apache Airflow

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Elyra extends JupyterLab with an AI centric approach.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.