AIbase
Home
AI Tutorial

RDM-Automation

Public

This project automates the processing of retail data using PySpark on Google Cloud. It calculates profit metrics, demand-supply ratios, and rewards analysis, and schedules execution via Cloud Composer and Dataproc, storing results in Google Cloud Storage for analytics use.

airflowgcspysparkpython
Creat：2025-05-03T15:14:44
Update：2025-10-11T13:30:29
4
Stars
0
Stars Increase

Related projects

Airflow

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

43469
1年前
+40today

Argo Workflows

airflow

Workflow Engine for Kubernetes

16243
10个月前
+16today

Dolphinscheduler

airflow

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

14001
10个月前
+11today

Ibis

bigquery

the portable Python dataframe library

6262
1年前
+6today

SynapseML

ai

Simple and Distributed Machine Learning

5190
10个月前
+1today

Orchest

0
airflow

Build data pipelines, the easy way ?️

4144
10个月前
0

Spark Nlp

bert

State of the Art Natural Language Processing

4078
11个月前
+4today

Awesome Apache Airflow

0
airflow

Curated list of resources about Apache Airflow

3860
11个月前
0

Linkis

application-manager

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

3407
11个月前
+1today

DataSphereStudio

airflow

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

3232
10个月前
+2today