560 Open Source Benchmark Software Projects
Free and open source benchmark code projects including engines, APIs, generators, and tools.
Tsung 2010 ⭐
Tsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.
Phoronix Test Suite 1217 ⭐
The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking software.
Cluebenchmark Clue 1312 ⭐
中文语言理解基准测评 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
1m Go Tcp Server 1059 ⭐
benchmarks for implementation of servers which support 1 million connections
Java Sec Code 873 ⭐
Java web common vulnerabilities and security code which is base on springboot and spring security
Slm Lab 836 ⭐
Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".
Microservices Framework Benchmark 583 ⭐
Raw benchmarks on throughput, latency and transfer of Hello World on popular microservices frameworks
Nench 552 ⭐
VPS benchmark script — based on the popular bench.sh, plus CPU and ioping tests, and dual-stack IPv4 and v6 speedtests by default
Nbench 488 ⭐
Performance benchmarking and testing framework for .NET applications :chart_with_upwards_trend:
Tf_to_trt_image_classification 409 ⭐
Image classification with NVIDIA TensorRT from TensorFlow models.
Caliper 411 ⭐
A blockchain benchmark framework to measure performance of multiple blockchain solutions https://wiki.hyperledger.org/display/caliper
Completely Unscientific Benchmarks 401 ⭐
Mimic3 Benchmarks 408 ⭐
Python suite to construct benchmark machine learning datasets from the MIMIC-III clinical database.
Blurtestandroid 389 ⭐
This is a simple App to test some blur algorithms on their visual quality and performance.
Ffi Overhead 365 ⭐
comparing the c ffi (foreign function interface) overhead on various programming languages
Molecularsets Moses 381 ⭐
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Layoutframeworkbenchmark 292 ⭐
Benchmark the performances of various Swift layout frameworks (autolayout, UIStackView, PinLayout, LayoutKit, FlexLayout, Yoga, ...)
Nanobench 330 ⭐
Simple, fast, accurate single-header microbenchmarking functionality for C++11/14/17/20
Lanczosnetwork 281 ⭐
Lanczos Network, Graph Neural Networks, Deep Graph Convolutional Networks, Deep Learning on Graph Structured Data, QM8 Quantum Chemistry Benchmark, ICLR 2019
Superpixel Benchmark 251 ⭐
An extensive evaluation and comparison of 28 state-of-the-art superpixel algorithms on 5 datasets.
Pyaf 255 ⭐
PyAF is an Open Source Python library for Automatic Time Series Forecasting built on top of popular pydata modules.
App Servers 230 ⭐
Songlab Cal Tape 216 ⭐
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.
Sangrenel 178 ⭐
Apache Kafka load testing "...basically a cloth bag filled with small jagged pieces of scrap iron"
Jax Rs Performance Comparison 178 ⭐
:zap: Performance Comparison of Jax-RS implementations and embedded containers
Benedekrozemberczki Datasets 163 ⭐
A repository of pretty cool datasets that I collected for network science and machine learning research.
Hand_pose_action 160 ⭐
Dataset and code for the paper "First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations", CVPR 2018.
Blue_benchmark 142 ⭐
BLUE benchmark consists of five different biomedicine text-mining tasks with ten corpora.
Are We Fast Yet 138 ⭐
Are We Fast Yet? Comparing Language Implementations with Objects, Closures, and Arrays
Meter 124 ⭐
Meter - is a simple micro-benchmarking tool for Android (and Java) projects. This is not a profiler, this is very small utility class that designed for making benchmarking easy. Nothing more. Alternative to Android Jetpack Benchmark.
Gatling Dubbo 126 ⭐
A gatling plugin for running load tests on Apache Dubbo(https://github.com/apache/incubator-dubbo) and other java ecosystem.
Volley 119 ⭐
Volley is a benchmarking tool for measuring the performance of server networking stacks.
Arewefastyet 117 ⭐
Hpatches Benchmark 116 ⭐
Python & Matlab code for local feature descriptor evaluation with the HPatches dataset.
Lmdbjava Benchmarks 110 ⭐
Benchmark of open source, embedded, memory-mapped, key-value stores available from Java (JMH)
Mixbench 113 ⭐
A GPU benchmark tool for evaluating GPUs on mixed operational intensity kernels (CUDA, OpenCL, HIP)
Factory_bot_instruments 105 ⭐
Instruments for benchmarking, tracing, and debugging Factory Girl models.
Dbench 111 ⭐
Benchmark Kubernetes persistent disk volumes with fio: Read/write IOPS, bandwidth MB/s and latency
Tape Neurips2019 104 ⭐
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)
Meta Blocks 103 ⭐
A modular toolbox for meta-learning research with a focus on speed and reproducibility.
Http Router 100 ⭐
:tada: Release 2.0 is released! Very fast HTTP router for PHP 7.1+ based on PSR-7 and PSR-15 with support for annotations and OpenApi (Swagger)
Bucketbench 87 ⭐
Go-based framework for running benchmarks against Docker, containerd, runc, or any CRI-compliant runtime
Worlddowntown Benchmark 86 ⭐
The Benchmark⏲ module provides methods to measure and report the time used to execute Swift code.
Karma Benchmark 86 ⭐
A Karma plugin to run Benchmark.js over multiple browsers with CI compatible output.
Gl Bench 82 ⭐
⏱ WebGL performance monitor and profiling tool that showing percentage of CPU/GPU load.
Php Arrays In Memory Comparison 81 ⭐
How to store 11kk items in memory? Comparison of methods: array vs object vs SplFixedArray vs pack vs swoole_table vs swoole_pack vs redis vs memsql vs node.js arrays in php7
Crossplatformdisktest 84 ⭐
Windows, macOS and Android storage (HDD, SSD, RAM) speed testing/performance benchmarking app
Xrautomatedtests 73 ⭐
XRAutomatedTests is where you can find functional, graphics, performance, and other types of automated tests for your XR Unity development.
Scimlbenchmarks.jl 82 ⭐
Benchmarks for scientific machine learning (SciML) software and differential equation solvers
Ncnn Benchmark 68 ⭐
The benchmark of ncnn that is a high-performance neural network inference framework optimized for the mobile platform
Http Benchmark Tornado 65 ⭐
基于Python Tornado的高性能http性能测试工具。Java Netty版: https://github.com/junneyang/http-benchmark-netty 。
Performancebenchmarkreporter 63 ⭐
The Unity Performance Benchmark tool enables partners and developers to establish benchmark samples and measurements using the Performance Testing package, then use these benchmark values to compare subsequent performance test results in an html output utilizing graphical visualizations.
Mini Nbody 65 ⭐
A simple gravitational N-body simulation in less than 100 lines of C code, with CUDA optimizations.
Typescript Runtime Type Benchmarks 66 ⭐
Benchmark Comparison of Packages with Runtime Validation and TypeScript Support
Functional Components Benchmark 60 ⭐
Directly calling functional components instead of mounting them is faster.
Benchmark Websocket 59 ⭐
Websocket Client and Server for benchmarks with Millions of concurrent connections.
Knowledge_distillation_via_tf2.0 58 ⭐
The codes for recent knowledge distillation algorithms and benchmark results via TF2.0 low-level API
Bench Routes 51 ⭐
Bench-routes is a monitoring tool that monitors from system/kernel level information to the application level logs and performance of routes in unix-based systems. For more info, refer to docs.
Teastore 50 ⭐
A micro-service reference test application for model extraction, cloud management, energy efficiency, power prediction, single- and multi-tier auto-scaling
Facies_classification_benchmark 52 ⭐
The repository includes PyTorch code, and the data, to reproduce the results for our paper titled "A Machine Learning Benchmark for Facies Classification" (published in the SEG Interpretation Journal, August 2019).
Plf_nanotimer 48 ⭐
A simple C++ 03/11/etc timer class for ~microsecond-precision cross-platform benchmarking. The implementation is as limited and as simple as possible to create the lowest amount of overhead.
Tfm 46 ⭐
Tyler's Frame Machine is a simple, free, educational, and portable tool for testing, benchmarking, comparison, and demonstration. TFM supports OpenGL, DirectX 11, DirectX 12, Metal, and most importantly, Vulkan! https://tylemagne.github.io/TFM
Wordpress Speedtest 46 ⭐
VPS Speedtest for WordPress with 160 results: 🏆 UpCloud (raw memory and CPU benchmark)
Dbbench 45 ⭐
🏋️ dbbench is a simple database benchmarking tool which supports several databases and own scripts
Python_portfolio__var_tool 50 ⭐
Python-based portfolio / stock widget which sources data from Yahoo Finance and calculates different types of Value-at-Risk (VaR) metrics and many other (ex-post) risk/return characteristics both on an individual stock and portfolio-basis, stand-alone and vs. a benchmark of choice (constructed with wxPython)
Pytest Django Queries 49 ⭐
Generate performance reports from your django database performance tests.
Perfy 45 ⭐
A simple, light-weight NodeJS utility for measuring code execution in high-resolution real times.
Streambench 43 ⭐
Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark
Bestconf 43 ⭐
A tool automatically improving the performance of large-scale systems by finding better configuration settings
Pspdfkit Webassembly Benchmark 41 ⭐
Source for the PSPDFKit WebAssembly Benchmark: http://iswebassemblyfastyet.com
Image Compression Benchmarking 37 ⭐
Image compression codecs benchmark inspired by Google's "Full Resolution Image Compression with Recurrent Neural Networks"
Dataracebench 38 ⭐
Data race benchmark suite for evaluating OpenMP correctness tools aimed to detect data races.
Benchmarkfcns 36 ⭐
A collection of mathematical test functions for benchmarking optimization algorithms.
Zakzak 36 ⭐
Makes microbenchmarking in node.js projects easier by using a "unit test"-like approach.
Segmentation Networks Benchmark 35 ⭐
Evaluation framework for testing segmentation networks in Keras
Kubernetes Iperf3 39 ⭐
Simple wrapper around iperf3 to measure network bandwidth from all nodes of a Kubernetes cluster
Scrnaseq_cell_cluster_labeling 35 ⭐
Scripts to run and benchmark scRNA-seq cell cluster labeling methods
Http Benchmark Netty 34 ⭐
基于Java Netty的HTTP客户端工具 & HTTP高性能测试工具。参数灵活定制、支持邮件报表等。Python Tornado版: https://github.com/junneyang/http-benchmark-tornado 。
Cloud Workbench 33 ⭐
Cloud WorkBench (CWB) is a web-based framework that is grounded on the notion of Infrastructure-as-Code (IaC) to foster simple definition, execution, and repetition of benchmarks over a wide array of cloud providers and configurations.
Shabados Database 33 ⭐
A digital representation of Sikh Bani and other Panthic texts with a public logbook of sangat-sourced corrections.
Spatial_index_benchmark 31 ⭐
Simple non-academic performance comparison of available open source implementations of R-tree spatial index using linear, quadratic and R* balancing algorithms as well as bulk loading.
Centos Bench Security 30 ⭐
CentOS Bench for Security is a script that implements checks which follows the CIS CentOS Linux 7 Benchmark.
Awesome State Of Depth Completion 66 ⭐
Current state of supervised and unsupervised depth completion methods
Okutama Action 31 ⭐
Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detection
Pdf Text Extraction Benchmark 30 ⭐
A project about benchmarking and evaluating existing PDF extraction tools on their semantic abilities to extract the body texts from PDF documents, especially from scientific articles.
Go Test Driven Development 29 ⭐
:hammer: :wrench: Test Driven Development :repeat: with Golang :hamster:
Corebench 27 ⭐
corebench - run your benchmarks against high performance computing servers with many CPU cores
Esnext Benchmarks 27 ⭐
Benchmarks comparing ESNext features to their ES5 and various pre-processor equivalents
Godot Size Benchmarks 28 ⭐
Benchmarks to compare Godot binary sizes with different build-time options
Extended Berkeley Segmentation Benchmark 26 ⭐
Extended version of the Berkeley Segmentation Benchmark  used for evaluation in .
Worker Threads Node.js 26 ⭐
Benchmark nodeJS worker threads for calculating prime numbers, using various dataStructures
Face Renovation 55 ⭐
Official repository of the paper "HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment".
Bsc Pm Bots 25 ⭐
Barcelona OpenMP Task Suite is a collection of applications that allow to test OpenMP tasking implementations and compare its behaviour under certain circumstances: task tiedness, throttle and cut-offs mechanisms, single/multiple task generators, etc.
Php Simple Benchmark Script 25 ⭐
Очень простой скрипт тестирования быстродействия PHP | Very simple script for testing of PHP operations speed (rusoft repo mirror)
Compiler Benchmark 29 ⭐
Benchmarks compilation speeds of different combinations of languages and compilers.
Uuid Mysql Performance 26 ⭐
This repo contains a bunch of crude benchmark tests to test the performance of MySQL queries with UUIDs in various scenarios
Node Red Contrib Actionflows 23 ⭐
Provides a set of nodes to enable an extendable design pattern for flows.
Tcpdbench 24 ⭐
The Turing Change Point Detection Benchmark: An Extensive Benchmark Evaluation of Change Point Detection Algorithms on real-world data
Qmlbench 23 ⭐
Tool to easily benchmark QML/QtQuick (or your own QML components) performance on different hardware.
Sota On Monocular 3D Pose And Shape Estimation 26 ⭐
State-of-the-art methods on monocular 3D pose estimation / 3D mesh recovery
Elixir_port_benchmarks 21 ⭐
Quick-and-dirty benchmarks for using Ports to communicate with various languages.
Python Performance 21 ⭐
Performance benchmarks of Python, Numpy, etc. vs. other languages such as Matlab, Julia, Fortran.
Text2image Benchmark 21 ⭐
Performance comparison of existing GAN based Text To Image algorithms. (GAN-CLS, StackGAN, TAC-GAN)
Pytest Patterns 21 ⭐
A couple of examples showing how pytest and its plugins can be combined to solve real-world needs.
Php Framework Benchmark 19 ⭐
php framework benchmark (include laravel、symfony、silex、lumen、slim、yii2、tastphp etc)
Datacenter Speed Tests 26 ⭐
⚡ Test speed and pings to all DigitalOcean, Linode, AWS, GCP, and Vultr regions
Audit Test Automation 20 ⭐
The Audit Test Automation Package gives you the ability to get an overview about the compliance status of several systems. You can easily create HTML-reports and have a transparent overview over compliance and non-compliance of explicit setttings and configurations in comparison to industry standards and hardening guides.
Mrbald Ufw 19 ⭐
A minimalist framework for rapid server side applications prototyping in C++ with dependency injection support.
Wasm Render 20 ⭐
Software 3D renderer & rasteriser written in WASM/C & TypeScript to test / showcase WebAssembly and compare performance
Dlib Pytorch Benchmark 19 ⭐
A very naive and simple benchmark between dlib and pytorch in terms of space and time
Andygeiss Ecs 20 ⭐
Build your own Game-Engine based on the Entity Component System concept in Golang.
Iguana 17 ⭐
IGUANA is a benchmark execution framework for querying HTTP endpoints and CLI Applications such as Triple Stores. Contact: [email protected]
Istio Bench 18 ⭐
A benchmark tool for Istio. It measures CPU, Memory, Network usage of istio per number of services
Cyclenerd Benchmark 17 ⭐
🔮 Bash Script which runs several Linux benchmarks (Sysbench, UnixBench and Geekbench)
Nlu_benchmark_dataset 16 ⭐
自然语言理解 基准测试 数据集 | Benchmark datasets for Natural Language Understanding (NLU)
Unchase.fluentperformancemeter 16 ⭐
:hammer: Make the exact performance measurements of the public methods for public classes using this NuGet Package with fluent interface. Requires .Net Standard 2.0+. It is an Open Source project under Apache-2.0 License.
Benchmarkit 16 ⭐
Benchmark and analyze functions' time execution and results over the course of development
Benchmarkspythonjuliaandco 15 ⭐
Benchmark(s) of numerical programs with Python (and Scipy, Pythran, Numba), Julia and C++.
Ga Benchmark 15 ⭐
A benchmark for Geometric Algebra libraries, library generators, and code optimizers.
Abstract Rest Service Benchmark 15 ⭐
A set of template services in different languages and frameworks. An abstract performance comparison based on the endpoint throughput. There are no objective benefits, just an elementary comparison of primitive RESTful API services. :shipit:
Python Pytest Harvest 18 ⭐
Store data created during your `pytest` tests execution, and retrieve it at the end of the session, e.g. for applicative benchmarking purposes.
Ecommercesearchbench 15 ⭐
E-commerce search benchmark is the first end-to-end application benchmark for e-commerce search system with personalized recommendations.This work is joint with Prof. Jianfeng Zhan (http://www.benchcouncil.org/zjf.html) 's team, who is also the chair of International Open Benchmark Council (BenchCouncil, http://www.benchcouncil.org/).
Optimisationalgorithms 14 ⭐
Searching global optima with firefly algorithm and solving traveling salesmen problem with genetic algorithm
Npb Cpp 15 ⭐
NAS Parallel Benchmark Kernels are written in C++. The parallel versions are in FastFlow, TBB, and OpenMP.
Videonavqa 14 ⭐
An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)
Hyperspectral Soilmoisture Dataset 14 ⭐
Hyperspectral and soil-moisture data from a field campaign based on a soil sample. Karlsruhe (Germany), 2017.
Oktoberfestfooddataset 13 ⭐
Publication of our Oktoberfest Food Dataset for Object Detection methods
Startup Time 13 ⭐
A command-line benchmarking tool to measure the startup times of programs in various languages
Smart Beta Portfolio Optimization 13 ⭐
Built a smart beta portfolio and compared it to a benchmark index by calculating the tracking error. Built a portfolio using quadratic programming to optimize the weights..
Text Representation 13 ⭐
Text representation works, such as : paper, code, review, datasets, blogs, thesis and so on.
Serialization Benchmark 12 ⭐
benchmark for modern serialization systems: Apache Avro, Protocol Buffers, Apache Thrift and MessagePack written in Scala
Sightglass 13 ⭐
A benchmark suite and tool to compare different implementations of the same primitives.
Julia Matlab Benchmark 12 ⭐
This repository is a place for accurate benchmarks between Julia and MATLAB and comparing the two.
Unified_tracking_benchmark 11 ⭐
An easy-to-use tool for evaluating tracking algorithms on many different benchmarks like OTB and Temple-Color
Leo Project Notes 11 ⭐
The note of LeoFS' developers and LeoFS' benchmark report to developers and users
Trainbenchmark 10 ⭐
The Train Benchmark framework for evaluating incremental model validation performance
Go Complex Nums Emulation 10 ⭐
Emulating builtin complex numbers with structs of floats and measuring the results
Web Tooling Benchmark Generator 10 ⭐
CLI tools to generate new benchmarks in v8/web-tooling-benchmark.
Faster Multimethods 10 ⭐
Almost backwards compatible alternative to Clojure 1.8.0 implementation of multimethods with roughly 1/10 the method lookup cost.
Dl_text_classification 11 ⭐
Collection of Deep Learning Text Classification Models in Keras; Includes a GPU tutorial.
Pytorch Ml 10 ⭐
:books::orange: Implement DNN or ML models and advanced policies with PyTorch.(Include experiment)
Arline_benchmarks 13 ⭐
Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes
Easyiterator 102 ⭐
🏃 Iterators made easy! Zero cost abstractions for designing and using C++ iterators.
Embedded Ai.bench 93 ⭐
benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.
Ddio Bench 10 ⭐
Reexamining Direct Cache Access to Optimize I/O Intensive Applications for Multi-hundred-gigabit Networks
Indonlu 102 ⭐
The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained models, and a starter code! (AACL-IJCNLP 2020)
Fizzboom 17 ⭐
Benchmark to compare async web server + interpreter + web client implementations across various languages
bad-slug 29 ⭐
Sample benchmark files for Hyperledger Caliper https://wiki.hyperledger.org/display/caliper
bad-slug 16 ⭐
A distributed storage benchmark for file systems and block devices with support for GPUs
bad-slug 10 ⭐
Tool for benchmarking apis. Uses ApacheBench(ab) to generate data and gnuplot for graphing. Adding new features almost daily