56 Open Source Evaluation Metrics Software Projects
Free and open source evaluation metrics code projects including engines, APIs, generators, and tools.
Ab3Dmot 1234 ⭐
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Pynlpl 444 ⭐
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).
Ner Evaluation 165 ⭐
An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the tokens that are part of the named-entity
Jiwer 249 ⭐
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
Generative Evaluation Prdc 160 ⭐
Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
Rankeval 76 ⭐
Official repository of RankEval: An Evaluation and Analysis Framework for Learning-to-Rank Solutions.
Semantic Object Accuracy For Generative Text To Image Synthesis 96 ⭐
Code for "Semantic Object Accuracy for Generative Text-to-Image Synthesis" (TPAMI 2020)
Precision Recall Distributions 64 ⭐
Assessing Generative Models via Precision and Recall (official repository)
Nereval 48 ⭐
Evaluation script for named entity recognition (NER) systems based on entity-level F1 score.
Sharmaroshan Twitter Sentiment Analysis 82 ⭐
It is a Natural Language Processing Problem where Sentiment Analysis is done by Classifying the Positive tweets from negative tweets by machine learning models for classification, text mining, text analysis, data analysis and data visualization
Summary Reward No Reference 23 ⭐
A reference-free metric for measuring summary quality, learned from human ratings.
Musdr 27 ⭐
Evaluation metrics for machine-composed symbolic music. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Music through Quantitative Measures", ISMIR 2020
Insurance Claim Prediction 21 ⭐
In this Data set we are Predicting the Insurance Claim by each user, Machine Learning algorithms for Regression analysis are used and Data Visualization are also performed to support Analysis.
Ml Performance Evaluation 13 ⭐
This repository includes analysis of classification results based on Receiver Operating Characteristic (ROC) Curve and Cumulative Accuracy Profile (CAP) Curves.
Restaurant Reviews Analysis 11 ⭐
Using Natural Language Processing and Bag of Words for feature extraction for sentiment analysis of the customers visited in the Restaurant and at last using Classification algorithm to separate Positive and Negative Sentiments.
World Food Production 12 ⭐
Comparing Top food and feed Producers around the globe and also seeking some interesting answers, solutions, patterns, hints and warnings through the power of Data Analysis and Data Visualization using Machine Learning.
Clubmark 14 ⭐
Clubmark: a Parallel Isolation Framework for Benchmarking and Profiling of Clustering (Community Detection) Algorithms Considering Overlaps (Covers)
Octis 282 ⭐
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
Image Similarity Measures 199 ⭐
:chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
Rliable 303 ⭐
Library for reliable evaluation on RL and ML benchmarks, as recommended by our NeurIPS 2021 Outstanding Paper.
Factcc 95 ⭐
Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
Person Reid Evaluation 82 ⭐
GOM：New Metric for Re-identification. 👉GOM explicitly balances the effect of performing retrieval and verification into a single unified metric.
Pysodevaltoolkit 40 ⭐
A Python-based RGB/RGB-D Salient Object Detection and Camouflaged Object Detection, and Co-Salient Object Detection evaluation toolbox.
Guap 23 ⭐
Open-source evaluation metric for linking Machine Learning model outputs with Business outcomes
Quica 19 ⭐
quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex
Big Mart Sales Prediction 17 ⭐
Using Machine Learning Algorithms for Regression Analysis to predict the sales pattern and Using Data Analysis and Data Visualizations to Support it.
Students Performance Analytics 13 ⭐
Students Performance Evaluation using Feature Engineering, Feature Extraction, Manipulation of Data, Data Analysis, Data Visualization and at lat applying Classification Algorithms from Machine Learning to Separate Students with different grades
Mlfromscratch 14 ⭐
Library for machine learning where all algorithms are implemented from scratch. Used only numpy.
Sod_evaluation_metrics 15 ⭐
A more complete python version (GPU) of the evaluation for salient object detection (with S-measure, Fbw measure, MAE, max/mean/adaptive F-measure, max/mean/adaptive E-measure, PRcurve and F-measure curve)
Benchmarks For Single Object Visual Tracking 11 ⭐
Exploring through 7 popular datasets for visual object tracking, including OTB, UAV, VOT, LaSOT, NFS, TrackingNet and GOT-10k.
Boston House Price Predictions 11 ⭐
The most basic data set available to practice the concepts of regression analysis and explore the most basic concepts of machine learning
Online Retail Transactions Of Uk 11 ⭐
Analyzing the Online Transactions in UK and the countries who are purchase stuff from them and analyzing the reviews from them using NLP and Machine Learning
Time Series Forecasting Using Machine Learning Algorithm 10 ⭐
Sensor data of a renowned power plant has given by a reliable source to forecast some feature. Initially the work has done with KNIME software. Now the goal is to do the prediction/forecasting with machine learning. The idea is to check the result of forecast with univariate and multivariate time series data. Regression method, Statistical method.