Popular GitHub Repositories for Elt

A system for agentic LLM-powered data processing and ETL

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Build reliable AI and agentic applications with DataFrames

A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.

数据仓库环境下的ELT数据管道实现

NLP parser using NER and TDD

Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE

Script to extract collections from MongoDB and load it to Parquet

? Pipeline de ingestão e análise com AWS Glue, Athena e S3, utilizando arquivos Parquet e catalogação automatizada via Crawler. Permite consultas SQL rápidas e eficientes sobre dados armazenados na nuvem.

数据工程项目 - 自动化批量数据处理

"? A job-ready, hands-on repository for practical LLM development! Master prompt engineering, fine-tuning, retrieval-augmented generation (RAG), and more with real-world examples and best practices. Perfect for AI engineers looking to build and deploy powerful language models."

ELT Base: Transferência e Modelagem de Dados OLTP → OLAP

Deployment of a containerized ELT/ETLT architecture integrating Airbyte for data extraction, python for data processing, and ClickHouse-dbt for analytical modeling and transformation. This project enables experimentation with new data extraction and processing use cases using Airbyte and python, while ensuring portability through Docker

Modern ELT pipeline for EdTech using Snowflake, dbt & Dagster. Automated analytics, CI/CD, orchestration & scheduling demo.

Using MLOps and ETL pipeline, an end-to-end machine learning model developed to forecast the Consignment Product.

一家咖啡店的聊天机器人，它能根据用户的输入生成独特的AI代理生成的文本输出。

About This project is an innovative coffee shop application designed to bring an engaging and personalized experience to coffee lovers. The app leverages AI-powered agents for chat-based interactions and integrates modern web and mobile development techniques to provide seamless ordering and delivery services.

Stepflux - A platform, built on AWS, to programmatically author, schedule, and monitor workflows

dagster for orchestration of tasks

ELT pipeline using dbt, snowflake, and airflow