128 Open Source Explainable Ai Software Projects

Fit interpretable models. Explain blackbox machine learning.

Debugging, monitoring and visualization for Python Machine Learning and Data Science

In-Database Machine Learning

Interpretability and explainability of data and machine learning models

moDel Agnostic Language for Exploration and eXplanation

Code, exercises and tutorials of my personal blog ! 📝

XAI - An eXplainability toolbox for machine learning

Generate Diverse Counterfactual Explanations for any machine learning model.

Leave One Feature Out Importance

🕵️‍♂️ Interpreting Convolutional Neural Network (CNN) Results.

📍 Interactive Studio for Explanatory Model Analysis

A repository for explaining feature attributions and feature interactions in deep neural networks.

💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)

Using / reproducing ACD from the paper "Hierarchical interpretations for neural network predictions" 🧠 (ICLR 2019)

Pytorch implementation of "Explainable and Explicit Visual Reasoning over Scene Graphs "

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code.

Causal Explanation (CXPlain) is a method for explaining the predictions of any machine-learning model.

Code repository for "Interpretable and Accurate Fine-grained Recognition via Region Grouping", CVPR 2020 (Oral)

Explaining the output of machine learning models with more accurately estimated Shapley values

Code for using CDEP from the paper "Interpretations are useful: penalizing explanations to align neural networks with prior knowledge" https://arxiv.org/abs/1909.13584

A fast Tsetlin Machine implementation employing bit-wise operators, with MNIST demo.

Detect model's attention

Examples of Data Science projects and Artificial Intelligence use cases

Workshop: Explanation and exploration of machine learning models with R and DALEX at eRum 2020

FairPut - Machine Learning Fairness Framework with LightGBM — Explainability, Robustness, Fairness (by @firmai)

Fast approximate Shapley values in R

code release for Representer point Selection for Explaining Deep Neural Network in NeurIPS 2018

Essential NLP & ML, short & fast pure Python code

All about explainable AI, algorithmic fairness and more

In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.

Modular Python Toolbox for Fairness, Accountability and Transparency Forensics

Contrastive Explanation (Foil Trees), developed at TNO/Utrecht University

Visualize BERT's self-attention layers on text classification tasks

(Explainable AI) - Learning Non-Monotonic Logic Programs From Statistical Models Using High-Utility Itemset Mining

Information Bottlenecks for Attribution

Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''

This project provides GOLang implementation of Neuro-Evolution of Augmented Topologies (NEAT) with Novelty Search optimization aimed to solve deceptive tasks with strong local optima

Amazon SageMaker Solution for explaining credit decisions.

In this part, I've introduced and experimented with ways to interpret and evaluate models in the field of image. (Pytorch)

Repo for Tang et al, bioRxiv 454793 (2018)

Using deep learning to discover interpretable representations for mammogram classification and explanation

Open source software for machine learning production monitoring : maintain control over production models, detect bias, explain your results.

Python library for Ceteris Paribus Plots (What-if plots)

Using / reproducing DAC from the paper "Disentangled Attribution Curves for Interpreting Random Forests and Boosted Trees"

Interpreting DNNs, Relative attributing propagation

Explains machine learning models fast using the Anchor algorithm originally proposed by marcotcr in 2018

Slides, videos and other potentially useful artifacts from various presentations on responsible machine learning.

The Machine Learning Toybox for testing the behavior of autonomous agents.

Implementation of the Anchors algorithm: Explain black-box ML models

💡 Adversarial attacks on model explanations, and evaluation approaches

Variable importance via oscillations

SIREN: A Simulation Framework for Understanding the Effects of Recommender Systems in Online News Environments

Machine Learning Finite State Machine Models from Data with Genetic Algorithms

In this work, we propose a deterministic version of Local Interpretable Model Agnostic Explanations (LIME) and the experimental results on three different medical datasets shows the superiority for Deterministic Local Interpretable Model-Agnostic Explanations (DLIME).

Article for Special Edition of Information: Machine Learning with Python

Model Agnostic Counterfactual Explanations

Visual Explanation using Uncertainty based Class Activation Maps

A collection of research materials on explainable AI/ML

CEML - Counterfactuals for Explaining Machine Learning models - A Python toolbox

This repository contains PyTorch implementation for the baseline models from the paper Utterance-level Dialogue Understanding: An Empirical Study

A collection of research papers and software related to explainability in graph machine learning.

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

Human-explainable AI.

This project provides responsible AI user interfaces for Fairlearn, interpret-community, and Error Analysis, as well as foundational building blocks that they rely on.

Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

Explainability for Vision Transformers

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).

List of relevant resources for machine learning from explanatory supervision

A Python package for unwrapping ReLU DNNs

Implementation of the paper "Shapley Explanation Networks"

Code for our USENIX Security 2021 paper -- CADE: Detecting and Explaining Concept Drift Samples for Security Applications

[CVPR2021] "Visualizing Adapted Knowledge in Domain Transfer". Visualization for domain adaptation. #explainable-ai

SEG-GRAD-CAM: Interpretable Semantic Segmentation via Gradient-Weighted Class Activation Mapping

[CVPR 2020] "Learning to Structure an Image with Few Colors". Critical structure for network recognition. #explainable-ai

This is a Pytorch implementation of GraphLIME

Repository for the COLING 2020 paper "Explainable Automated Fact-Checking: A Survey."

👋 Xplique is a Neural Networks Explainability Toolbox

Library implementing state-of-the-art Concept-based and Disentanglement Learning methods for Explainable AI

Explaining dimensionality results using SHAP values

This Repo containes the implemnetation of generating Guided-GradCAM for 3D medical Imaging using Nifti file in tensorflow 2.0. Different input files can be used in that case need to edit the input to the Guided-gradCAM model.

PyTorch Explain: Logic Explained Networks in Python.

Dataset and code for "Explainable Automated Fact-Checking for Public Health Claims" from EMNLP 2020.

ProtoTrees: Neural Prototype Trees for Interpretable Fine-grained Image Recognition, published at CVPR2021

Links to conference/journal publications in automated fact-checking (resources for the TACL21 paper).

GradCAM Pytorch

A toolkit for efficent computation of saliency maps for explainable AI attribution. This tool was developed at Lawrence Livermore National Laboratory.

Code to reproduce our paper on probabilistic algorithmic recourse: https://arxiv.org/abs/2006.06831

Explainability of Deep Learning Models

GAM (Global Attribution Mapping) explains the landscape of neural network predictions across subpopulations

Deep Logic is a python package providing a set of utilities to build deep learning models that are explainable by design.

Source code for 'Lemna: Explaining deep learning based security applications'.

Code and data for decision making under strategic behavior

A collection of algorithms of counterfactual explanations.

MTUNet: Few-shot Image Classification with Visual Explanations

Automated Transparent Genetic Feature Engineering

GEBI: Global Explanations for Bias Identification. Open source code for discovering bias in data with skin lesion dataset