Popular GitHub Repositories for Dataflow

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Dataflow compiler for QNN inference on FPGAs

Explore the energy-efficient dataflow scheduling for neural networks.

Dataflow system for building self-driving car and robotics applications.

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

Slipstream提供了一种数据流模型，简化了有状态流式应用程序的开发。

Video Clip Analytics By Using Dataflow and Video AI For Object Tracking

???可视化拖拽式大数据集成平台前端，包含数据流、数据源、数据对齐、查询模板、完善的监控等。像画流程图一样且无代码方式同步、清洗数据。

This project shows how to derive the total number of training tokens from a large text dataset from ? datasets with Apache Beam and Dataflow.

Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)

Integrates LLMs as PTransform in Apache Beam pipelines using LangChain

Presents an optimized Apache Beam pipeline for generating sentence embeddings (runnable on Cloud Dataflow).

A content discovery platform powered by LLMs

Learning embeddings from item co-occurrence statistics, and building an approx. nearest neighbour index

Shows how to perform text preprocessing using BigQuery, tf.hub, tf.transform, and Dataflow to perform Text Similarity Analysis

Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

invoke a python-trained tensorflow model from java programs,Real-time image recognition,and deploy the applications to springcloud dataflow local server

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.