66 Open Source Batch Processing Software Projects
Free and open source batch processing code projects including engines, APIs, generators, and tools.
Spring Cloud Dataflow 703 ⭐
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Krita Batch Exporter 194 ⭐
A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...
Ida Batch_decompile 184 ⭐
*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file
Excel Parser Processor 169 ⭐
Simply does the tedious, repetitive operations for all rows of an excel file step by step and reports after the job is done. For example it can download URL(s) in a column of an Excel file. If a new filename is provided at column B it will rename the file before saving.
Revitbatchprocessor 107 ⭐
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
Seznam Euphoria 74 ⭐
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
Cekirdekler 75 ⭐
Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).
Openrefine Batch 55 ⭐
Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.
Batchman 47 ⭐
This library for Android will take any set of events and batch them up before sending it to the server. It also supports persisting the events on disk so that no event gets lost because of an app crash. Typically used for developing any in-house analytics sdk where you have to make a single api call to push events to the server but you want to optimize the calls so that the api call happens only once per x events, or say once per x minutes. It also supports exponential backoff in case of network failures
Dynamoautomation 42 ⭐
Batch-processing of Revit models using the Dynamo visual programming environment
Ifiscripts 41 ⭐
Detailed documentation is available here: http://ifiscripts.readthedocs.io/en/latest/index.html
Tacc Launcher 31 ⭐
A simple utility for executing multiple sequential or multi-threaded applications in a single multi-node batch job
Optbinning 36 ⭐
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning
Tf Faster Rcnn 45 ⭐
Tensorflow 2 Faster-RCNN implementation from scratch supporting to the batch processing with MobileNetV2 and VGG16 backbones
Lean Batch Launcher 27 ⭐
Unofficial alternative launcher for QuantConnect's LEAN allowing for parallel execution and looping/batching with customizable parameters and ranges.
Cogstack Pipeline 24 ⭐
Distributed, fault tolerant batch processing for Natural Language Applications and Search, using remote partitioning
Azure Certification Dp 200 21 ⭐
Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution
Hos Metadatatransformations 19 ⭐
DEPRECATED - no longer actively maintained. Automated workflow for harvesting, transforming and indexing of metadata using metha, OpenRefine and Solr. Part of the Hamburg Open Science "Schaufenster" software stack.
Generic Batch Processor 16 ⭐
”Building a concurrent and distributed system for batch processing which is fault tolerant and can scale up or scale out using Akka.NET (based on actor model)”.
Elasticbatch 17 ⭐
Elasticsearch buffer for collecting and batch inserting Python data and pandas DataFrames
Sapporo 11 ⭐
SAPPORO is a workflow and individual task execution system. It is also useful for continuous testing of workflows.
Abaqus_python_batch 11 ⭐
Python scripts for the Abaqus FEA Python interpreter that allows for robust, flexible batch processing of output (.odb) files.
Python Batch Runner 10 ⭐
A tiny framework for building batch applications as a collection of tasks in a workflow.