56 Open Source Evaluation Metrics Software Projects
Free and open source evaluation metrics code projects including engines, APIs, generators, and tools.
Evaluation script for named entity recognition (NER) systems based on entity-level F1 score.
Ner Evaluation165 ⭐
An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the tokens that are part of the named-entity
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
Clubmark: a Parallel Isolation Framework for Benchmarking and Profiling of Clustering (Community Detection) Algorithms Considering Overlaps (Covers)
Precision Recall Distributions64 ⭐
Assessing Generative Models via Precision and Recall (official repository)
Ml Performance Evaluation13 ⭐
This repository includes analysis of classification results based on Receiver Operating Characteristic (ROC) Curve and Cumulative Accuracy Profile (CAP) Curves.
Big Mart Sales Prediction17 ⭐
Using Machine Learning Algorithms for Regression Analysis to predict the sales pattern and Using Data Analysis and Data Visualizations to Support it.
Insurance Claim Prediction21 ⭐
In this Data set we are Predicting the Insurance Claim by each user, Machine Learning algorithms for Regression analysis are used and Data Visualization are also performed to support Analysis.
Sharmaroshan Twitter Sentiment Analysis82 ⭐
It is a Natural Language Processing Problem where Sentiment Analysis is done by Classifying the Positive tweets from negative tweets by machine learning models for classification, text mining, text analysis, data analysis and data visualization
Students Performance Analytics13 ⭐
Students Performance Evaluation using Feature Engineering, Feature Extraction, Manipulation of Data, Data Analysis, Data Visualization and at lat applying Classification Algorithms from Machine Learning to Separate Students with different grades
Restaurant Reviews Analysis11 ⭐
Using Natural Language Processing and Bag of Words for feature extraction for sentiment analysis of the customers visited in the Restaurant and at last using Classification algorithm to separate Positive and Negative Sentiments.
Boston House Price Predictions11 ⭐
The most basic data set available to practice the concepts of regression analysis and explore the most basic concepts of machine learning
World Food Production12 ⭐
Comparing Top food and feed Producers around the globe and also seeking some interesting answers, solutions, patterns, hints and warnings through the power of Data Analysis and Data Visualization using Machine Learning.
Online Retail Transactions Of Uk11 ⭐
Analyzing the Online Transactions in UK and the countries who are purchase stuff from them and analyzing the reviews from them using NLP and Machine Learning
Time Series Forecasting Using Machine Learning Algorithm10 ⭐
Sensor data of a renowned power plant has given by a reliable source to forecast some feature. Initially the work has done with KNIME software. Now the goal is to do the prediction/forecasting with machine learning. The idea is to check the result of forecast with univariate and multivariate time series data. Regression method, Statistical method.
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Summary Reward No Reference23 ⭐
A reference-free metric for measuring summary quality, learned from human ratings.
Semantic Object Accuracy For Generative Text To Image Synthesis96 ⭐
Code for "Semantic Object Accuracy for Generative Text-to-Image Synthesis" (TPAMI 2020)
Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
Benchmarks For Single Object Visual Tracking11 ⭐
Exploring through 7 popular datasets for visual object tracking, including OTB, UAV, VOT, LaSOT, NFS, TrackingNet and GOT-10k.
Library for machine learning where all algorithms are implemented from scratch. Used only numpy.
Generative Evaluation Prdc160 ⭐
Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
Image Similarity Measures199 ⭐
:chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
Evaluation metrics for machine-composed symbolic music. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Music through Quantitative Measures", ISMIR 2020
A Python-based RGB/RGB-D Salient Object Detection and Camouflaged Object Detection, and Co-Salient Object Detection evaluation toolbox.
Person Reid Evaluation82 ⭐
GOM：New Metric for Re-identification. 👉GOM explicitly balances the effect of performing retrieval and verification into a single unified metric.
quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex
Open-source evaluation metric for linking Machine Learning model outputs with Business outcomes
A more complete python version (GPU) of the evaluation for salient object detection (with S-measure, Fbw measure, MAE, max/mean/adaptive F-measure, max/mean/adaptive E-measure, PRcurve and F-measure curve)
Library for reliable evaluation on RL and ML benchmarks, as recommended by our NeurIPS 2021 Outstanding Paper.
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).