83 Open Source Batch Processing Software Projects
Free and open source batch processing code projects including engines, APIs, generators, and tools.
Spring Cloud Dataflow 810 ⭐
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Krita Batch Exporter 212 ⭐
A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...
Ida Batch_decompile 214 ⭐
*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file
Excel Parser Processor 184 ⭐
Automate Excel downloads in seconds. Simply does the tedious, repetitive operations for all rows of excel files step by step and reports after the job is done. It can download files from URL(s) in a column of Excel files. If a new filename is provided at column B it will rename the file before saving. It will even create sub folders if column C is filled with a valid folder name.
Revitbatchprocessor 143 ⭐
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
Seznam Euphoria 78 ⭐
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
Cekirdekler 77 ⭐
Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).
Openrefine Batch 67 ⭐
Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.
Batchman 51 ⭐
This library for Android will take any set of events and batch them up before sending it to the server. It also supports persisting the events on disk so that no event gets lost because of an app crash. Typically used for developing any in-house analytics sdk where you have to make a single api call to push events to the server but you want to optimize the calls so that the api call happens only once per x events, or say once per x minutes. It also supports exponential backoff in case of network failures
Dynamoautomation 47 ⭐
Batch-processing of Revit models using the Dynamo visual programming environment
Ifiscripts 45 ⭐
Detailed documentation is available here: http://ifiscripts.readthedocs.io/en/latest/index.html
Tacc Launcher 45 ⭐
A simple utility for executing multiple sequential or multi-threaded applications in a single multi-node batch job
Optbinning 170 ⭐
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
Tf Faster Rcnn 81 ⭐
Tensorflow 2 Faster-RCNN implementation from scratch supporting to the batch processing with MobileNetV2 and VGG16 backbones
Lean Batch Launcher 34 ⭐
Unofficial alternative launcher for QuantConnect's LEAN allowing for parallel execution and looping/batching with customizable parameters and ranges.
Cogstack Pipeline 31 ⭐
Distributed, fault tolerant batch processing for Natural Language Applications and Search, using remote partitioning
Azure Certification Dp 200 48 ⭐
Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution
Hos Metadatatransformations 18 ⭐
DEPRECATED - no longer actively maintained. Automated workflow for harvesting, transforming and indexing of metadata using metha, OpenRefine and Solr. Part of the Hamburg Open Science "Schaufenster" software stack.
Generic Batch Processor 17 ⭐
”Building a concurrent and distributed system for batch processing which is fault tolerant and can scale up or scale out using Akka.NET (based on actor model)”.
Elasticbatch 20 ⭐
Elasticsearch tool for easily collecting and batch inserting Python data and pandas DataFrames
Sapporo 11 ⭐
SAPPORO is a workflow and individual task execution system. It is also useful for continuous testing of workflows.
Abaqus_python_batch 13 ⭐
Python scripts for the Abaqus FEA Python interpreter that allows for robust, flexible batch processing of output (.odb) files.
Python Batch Runner 16 ⭐
A tiny framework for building batch applications as a collection of tasks in a workflow.
Null 510 ⭐
Make Flink|Spark easier!!! The original intention of StreamX is to make the development of Flink easier. StreamX focuses on the management of development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.
Null 58 ⭐
It is an efficient, flexible, and lightweight goroutine pool. It provides an easy way to deal with concurrent tasks with limited resource.
Null 16 ⭐
Video Converter & Transcoder, ffmpeg frontend: 1. set options, drag multiple files, 2. transcode MKV-MP4, 3. full manual edit of ffmpeg command, 4. record network streams, 5. batch list
Null 12 ⭐
(Developing)FLink.CSharp - a port of Apache Flink, an open source stream processing framework with powerful stream- and batch-processing capabilities. Learn more about Flink at https://flink.apache.org.