Popular GitHub Repositories for Lakehouse

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

The open-source, AI-native data stack

AI 时代的智能数据库

A BYOC option for Snowflake workloads

Local environment for running Factor House products (Kpow and Flex) along with supporting infrastructure using Docker Compose

A cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.

Supercharge Your Compute for Analytics & AI

My M.Sc. dissertation: Modern Data Platform using DataOps, Kubernetes, and Cloud-Native ecosystem to build a resilient Big Data platform based on Data Lakehouse architecture which is the base for Machine Learning (MLOps) and Artificial Intelligence (AIOps).

Scalable real-time fraud detection platform built on modern Data Lakehouse architecture

MCP Service for GigAPI Timeseries Lake

An end-to-end MLOps pipeline to develop, train, and deploy an Image Caption model that automatically generates captions for images based on diverse datasets

A simple Docker based playground that brings together popular open source data and AI tools to help others get started with data lakehouse architecture and GenAI development on their local machines.

Azure Machine Learning empowers data scientists and developers to build, deploy, and manage high-quality models faster and with confidence. It accelerates time to value with industry-leading machine learning operations (MLOps), open-source interoperability, and integrated tools.

End-to-end demo project using Microsoft Fabric to predict flight delays with AI and ML. Includes data ingestion, feature engineering, model training, explainability, and Power BI insights — all built on Lakehouse architecture with Copilot support.

Talk to Data: LLM-Based Dashboards and Reports from Data Lakehouse

Final Assignment ES234419 - Data Lakehouse

Data Lakehouse Project - Karachi Electric (Final-year project)