Big-Data-Project

Public

This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.

apache-airflow apache-kafka apache-spark batch-processing big-data-projects hbase hdfs ingestion java lambda-architecture

Creat：2024-04-02T10:33:48

Update：2025-03-17T16:32:32

https://youtu.be/iClZyC_TZyA

Stars

Stars Increase

Related projects

Superset

analytics

Apache Superset is a Data Visualization and Data Exploration Platform

67501

4个月前

+38today

Echarts

apache

Apache ECharts is a powerful, interactive charting and data visualization library for browser

64285

4个月前

+46today

Chatgpt On Wechat

基于大模型搭建的聊天机器人，同时支持微信公众号、企业微信应用、飞书、钉钉等接入，可选择GPT3.5/GPT-4o/GPT-o1/ DeepSeek/Claude/文心一言/讯飞星火/通义千问/ Gemini/GLM-4/Claude/Kimi/LinkAI，能处理文本、语音和图片，访问操作系统和互联网，支持基于自有知识库进行定制企业智能客服。

38445

4个月前

+26today

Data Engineering Zoomcamp

data-engineering

Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.

32293

4个月前

+39today

Pathway

Hot

batch-processing

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

30558

4个月前

+171today

Data Science Ipython Notebooks

aws

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

28455

4个月前

+7today