Redfin-Analytics-ETL-using-Amazon-EMR-by-Airflow-on-EC2

Public

This is an end-to-end AWS Cloud ETL project. This data pipeline uses an Amazon EMR cluster managed by Apache Airflow that is running on an AWS EC2 instance. It demonstrates how to build orchestration that would perform data transformation using Amazon EMR as well as automatic data ingestion into a Snowflake via Snowpipe. It also features Power BI.

amazon-emr-cluster apache-airflow apache-spark aws-ec2 aws-s3 business-intelligence dags data-visualization etl-pipeline google-colab-notebook

Creat：2025-04-11T03:25:07

Update：2025-04-11T04:27:11

Stars

Stars Increase

Related projects

Superset

analytics

Apache Superset is a Data Visualization and Data Exploration Platform

68429

6个月前

+5today

Echarts

apache

Apache ECharts is a powerful, interactive charting and data visualization library for browser

64777

6个月前

+5today

Airflow

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

42748

8个月前

+10today

Chatgpt On Wechat

基于大模型搭建的聊天机器人，同时支持微信公众号、企业微信应用、飞书、钉钉等接入，可选择GPT3.5/GPT-4o/GPT-o1/ DeepSeek/Claude/文心一言/讯飞星火/通义千问/ Gemini/GLM-4/Claude/Kimi/LinkAI，能处理文本、语音和图片，访问操作系统和互联网，支持基于自有知识库进行定制企业智能客服。

39324

6个月前

+16today

Data Engineering Zoomcamp

data-engineering

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

33039

6个月前

+11today

Data Science Ipython Notebooks

aws

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

28585

6个月前

+2today