113 Open Source Dataflow Software Projects

A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications

A Scala API for Apache Beam and Google Cloud Dataflow.

React to any event with serverless functions across clouds

⛱ Broadly scoped ecosystem & mono-repository of 160+ TypeScript projects for functional, data driven development

A DSL for data-driven computational pipelines

Robust, flexible and resource-efficient pipelines using Go and the commandline

The RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators

Workflows and interfaces for neuroimaging packages

Dispatch reducers

Streaming System 相关的论文读物

Experimental visual Go environment

A Pythonic framework for threat modeling

Open-source code analysis platform for C/C++/Java/Binary/Javascript/Kotlin based on code property graphs

A visual systems language for beginners compiled using LLVM

The Pothos data-flow framework

Creative apps to use, build, share, and hack in the browser.

Live dataflow programming for microcontrollers and embedded

:snake: Dataflow programming for python.

A visual representation and reference to Azure services

Vue2 dataflow graph editor

Embedded Multicore Building Blocks (EMB²): Library for parallel programming of embedded systems. Star us on GitHub? +1

A convenient Python wrapper for Apache NiFi

JavaScript dataflow graph editor

Distributed Flow-Based Programming via message queues

Explore the energy-efficient dataflow scheduling for neural networks.

A Flow-based Programming inspired micro-framework / un-framework for Go (Golang)

Python Data Processing library

⚖️ A lightweight Android lifecycle-aware and thread-safe pipeline for communicating between components with custom scopes.

🌱 Your companion to create derived values from a single source (atom)

Web-based Dataflow Framework for Visual Data Exploration

GCP Variant Transforms

The Refreshingly Simple Cross-Platform C++ Dataflow / Pipelining / Stream Processing / Reactive Programming Framework

Google Cloud Platform plugin for Eclipse

Vue 2 dataflow graph editor

Python Module for displaying flowgraphs using Pyside or PyQt.

Fully reactive programming for nodejs and the browser

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

Dnai Editor - Visual Scripting (Node Editor)

GUI frontend and designer tool for the Pothos framework

Ready-send coordination layer on top of goroutines.

Yer another array library

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery

Opinionated serverless event analytics pipeline

Tools for building reactive user interfaces in ClojureScript.

Streaming dataflow library for IoT applications. Program at a higher level, with reusable "things".

Flowgraph package for scalable asynchronous system development

End to End Machine Learning with Google Cloud Platform

A tiny framework to wrap algorithms for dataflow programming

Open RVC-CAL Compiler

Pothos framework support for software defined radio hardware.

A Runtime for Writing Real-time Analytics Applications in Rust

Dataprocessing framework for JavaScript 🎂

Go Taint CHeck Analyser

An analytical cost model evaluating DNN mappings (dataflows and tiling).

ACT hardware description language and core tools.

Pothos demonstration applications

A browser for Hacker News's Ask HN: Who's Hiring, with Matrix Inside(tm)

Log analysis pipeline utilizing Apache Beam

yet another databus that transfer/transform pipeline data between plugins

Cross-Platform Graphical Tool for DSPatch

Kestra, the modern, scalable orchestrator & scheduler open source platform.

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Slang user interface written in TypeScript and Angular

special node-red node used in Distrbuted Node-RED

DTask is a scheduler for statically dependent tasks.

The RStein.AsyncCpp library is a set of types that should be familiar for anyone who knows the Task Parallel Library (TPL) for .NET (C#).

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

Simulink toolbox to rapidly prototype robot controllers

This repository includes end-to-end labs on how to use GCP for applied data science

Communications blocks and support libraries

An inter-language runtime for flow-based programming (FBP)

Real-time sound synthesis and processing framework

Cocoon – a flow-based workflow automation, data mining and visual analytics tool.

A collection of core processing blocks

DSPatch Component Repository

A general framework for optimizing DNN dataflow on systolic array

Convenient Dataflow pipelines for transforming data between cloud data sources

Dataflow editor technical concept, using Raphaël.js/SVG

Video Clip Analytics By Using Dataflow and Video AI For Object Tracking

A lightweight library intended to make developing Google DataFlow jobs in Scala easier.

Data processing framework inspired by PortPHP

Open RVC-CAL Applications

Flow-based and dataflow programming library for Go (golang)

Simple flow library 🖥️🖱️

Flowistry is a VSCode extension that helps you understand Rust programs with program analysis.

Dataflow programming and declarative concurrency

CRUD apps as a function

Dataflow compiler for QNN inference on FPGAs

Graph / node editor in the browser using VueJS

An experimental self-hosted Observable notebook editor, with support for FileAttachments, Secrets, custom standard libraries, and more!

Dataflow system for building self-driving car and robotics applications.

A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.

IntelMQ Manager is a graphical interface to manage configurations for IntelMQ framework.

A Python framework for data processing on GCP.

Automatic Analysis (aa)

Cross-platform .NET library for computations whose arguments and results are objects that implement INotifyPropertyChanged and INotifyCollectionChanged (ObservableCollection) interfaces.

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).

Dataflow based workflow framework