raspberry-pi4-hadoop-spark-cluster

Public

This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.

big-data distributed-storage hadoop-cluster hdfs parallel-processing pyspark raspberry-pi-4 spark-cluster spark-shell yarn

Hora de creación：2024-07-12T07:25:58

Hora de actualización：2025-06-23T08:19:28

https://project.aimanuddin.com/raspberry-pi4-hadoop-spark-cluster/

Stars

Stars Increase

Proyectos relacionados

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

190741

1年前

+18today

N8n

Hot

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

118206

4年前

+360today

D3

chart

Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:

111051

1年前

+12today

Netdata

alerting

X-Ray Vision for your infrastructure!

75084

3个月前

+14today

Redis

cache

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

70003

4周前

+21today

Grafana

alerting

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

68988

3个月前

+24today