raspberry-pi4-hadoop-spark-cluster

Public

This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.

big-data distributed-storage hadoop-cluster hdfs parallel-processing pyspark raspberry-pi-4 spark-cluster spark-shell yarn

Creat：2024-07-12T07:25:58

Update：2025-06-23T08:19:28

https://project.aimanuddin.com/raspberry-pi4-hadoop-spark-cluster/

Stars

Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

191866

2年前

+9today

N8n

Hot

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

142634

4年前

+1138today

D3

chart

Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:

111568

1年前

+8today

Netdata

alerting

X-Ray Vision for your infrastructure!

76243

6个月前

+18today

Redis

cache

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

71043

3个月前

+14today

Grafana

alerting

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

70137

6个月前

+15today