252 Open Source Attention Mechanism Software Projects
Free and open source attention mechanism code projects including engines, APIs, generators, and tools.
Brightmart Text_classification 6544 ⭐
all kinds of text classification models and more with deep learning
Awesome Graph Classification 3766 ⭐
A collection of important graph embedding, classification and representation learning papers with implementations.
Kyubyong Transformer 3222 ⭐
A TensorFlow Implementation of the Transformer: Attention Is All You Need
Awesome Speech Recognition Speech Synthesis Papers 1633 ⭐
Speech synthesis, voice conversion, self-supervised learning, music generation,Automatic Speech Recognition, Speaker Verification, Speech Synthesis, Language Modeling
A Pytorch Tutorial To Image Captioning 1197 ⭐
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
Pygat 1174 ⭐
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
Textclassifier 970 ⭐
Text classifier for Hierarchical Attention Networks for Document Classification
Sockeye 972 ⭐
Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet
Chatbot_cn 665 ⭐
Pointer_summarizer 562 ⭐
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
Awesome Bert Nlp 473 ⭐
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
Keras Self Attention 437 ⭐
Attention mechanism for processing sequential data that considers the context for each timestamp.
Transformer Tts 360 ⭐
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
Action Recognition Visual Attention 345 ⭐
Action recognition using soft attention based deep recurrent neural networks
Soskek Attention_is_all_you_need 301 ⭐
Transformer of "Attention Is All You Need" (Vaswani et al. 2017) by Chainer.
Lc222 Seq2seq_chatbot 298 ⭐
基于seq2seq模型的简单对话系统的tf实现，具有embedding、attention、beam_search等功能，数据集是Cornell Movie Dialogs
Simgnn 305 ⭐
A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
Adaptiveattention 297 ⭐
Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"
Tensorflow_end2end_speech_recognition 294 ⭐
End-to-End speech recognition implementation base on TensorFlow (CTC, Attention, and MTL training)
Keras Gat 297 ⭐
Keras implementation of the graph attention networks (GAT) by Veličković et al. (2017; https://arxiv.org/abs/1710.10903)
Attentionalpoolingaction 238 ⭐
Code/Model release for NIPS 2017 paper "Attentional Pooling for Action Recognition"
Multi Scale Attention 234 ⭐
Code for our paper "Multi-scale Guided Attention for Medical Image Segmentation"
Lightnetplusplus 210 ⭐
LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
Deeplearning.ai Natural Language Processing Specialization 350 ⭐
This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai
Neat Vision 199 ⭐
Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)
Jayparks Transformer 193 ⭐
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
Guided Attention Inference Network 190 ⭐
Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.
Datastories Semeval2017 Task4 179 ⭐
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Yolo Multi Backbones Attention 210 ⭐
Model Compression—YOLOv3 with multi lightweight backbones(ShuffleNetV2 HuaWei GhostNet), attention, prune and quantization
Slot_filling_intent_joint_model 170 ⭐
attention based joint model for intent detection and slot filling
A Pytorch Tutorial To Text Classification 169 ⭐
Hierarchical Attention Networks | a PyTorch Tutorial to Text Classification
Attentive Gan Derainnet 169 ⭐
Unofficial tensorflow implemention of "Attentive Generative Adversarial Network for Raindrop Removal from A Single Image (CVPR 2018) " model https://maybeshewill-cv.github.io/attentive-gan-derainnet/
Graph_attention_pool 159 ⭐
Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)
Picanet Implementation 146 ⭐
Pytorch Implementation of PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection
Attention Mechanisms 158 ⭐
Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.
Seq2seq_chatbot_new 143 ⭐
基于seq2seq模型的简单对话系统的tf实现，具有embedding、attention、beam_search等功能，数据集是Cornell Movie Dialogs
Soujanyaporia Multimodal Sentiment Analysis 143 ⭐
Attention-based multimodal fusion for sentiment analysis
Attribute Aware Attention 137 ⭐
[ACM MM 2018] Attribute-Aware Attention Model for Fine-grained Representation Learning
Linformer Pytorch 150 ⭐
My take on a practical implementation of Linformer for Pytorch. https://arxiv.org/pdf/2006.04768.pdf
Transformer In Generating Dialogue 121 ⭐
An Implementation of 'Attention is all you need' with Chinese Corpus
Document Classifier Lstm 123 ⭐
A bidirectional LSTM with attention for multiclass/multilabel text classification.
Abstractive Summarization 120 ⭐
Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.
Linear Attention Recurrent Neural Network 115 ⭐
A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
Linear Attention Transformer 133 ⭐
Transformer based on a variant of attention that is linear complexity in respect to sequence length
Sinkhorn Transformer 110 ⭐
Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
Self Attentive Emb Tf 95 ⭐
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
Pytorch Question Answering 99 ⭐
Important paper implementations for Question Answering using PyTorch
Kac Net 92 ⭐
Implementation of Knowledge Aided Consistency for Weakly Supervised Phrase Grounding in Tensorflow
Ylg 91 ⭐
[CVPR 2020] Official Implementation: "Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models".
Image Caption Generator 100 ⭐
A neural network to generate captions for an image using CNN and RNN with BEAM Search.
Grounder 82 ⭐
Implementation of Grounding of Textual Phrases in Images by Reconstruction in Tensorflow
Simplednn 81 ⭐
SimpleDNN is a machine learning lightweight open-source library written in Kotlin designed to support relevant neural network architectures in natural language processing tasks
Narre 81 ⭐
This is our implementation of NARRE:Neural Attentional Regression with Review-level Explanations
Atpapers 83 ⭐
Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
Qrc Net 70 ⭐
Implementation of Query-guided Regression Network with Context Policy for Phrase Grounding in Tensorflow
Pytorch_sentiment_rnn 66 ⭐
Example Recurrent Neural Networks for Sentiment Analysis (Aspect-Based) on SemEval 2014
Group Level Emotion Recognition 65 ⭐
Model submitted for the ICMI 2018 EmotiW Group-Level Emotion Recognition Challenge
Ntua Slp Semeval2018 64 ⭐
Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.
Sarcasm Detection 63 ⭐
Detecting Sarcasm on Twitter using both traditonal machine learning and deep learning techniques.
Drln 82 ⭐
Densely Residual Laplacian Super-resolution, IEEE Pattern Analysis and Machine Intelligence (TPAMI), 2020
Tree_enhanced_embedding_model 62 ⭐
TEM: Tree-enhanced Embedding Model for Explainable Recommendation, WWW2018
Hierarchical Attention Networks 66 ⭐
TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification"
Patient2vec 62 ⭐
Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record
Pytorch Attention Guided Cyclegan 61 ⭐
Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.
Softalignments 60 ⭐
Neural macine translation soft alignment visualisations for web and command line
Tf Var Attention 62 ⭐
Tensorflow Implementation of Variational Attention for Sequence to Sequence Models (COLING 2018)
Stanet 69 ⭐
official implementation of the spatial-temporal attention neural network (STANet) for remote sensing image change detection
Chatbot Startkit 51 ⭐
This repository holds files for the simple chatbot wrote in TensorFlow 1.4, with attention mechanism and bucketing.
Xiaox 51 ⭐
flask+seq2seq【TensorFlow1.0, Pytorch】 :art: :art: 在线聊天机器人 https://mp.weixin.qq.com/s/VpiAmVSTin3ALA8MnzhCJA 或 https://ask.hellobi.com/blog/python_shequ/14486
Mehrdad Noori Brain Tumor Segmentation 50 ⭐
Attention-Guided Version of 2D UNet for Automatic Brain Tumor Segmentation
Video Description With Spatial Temporal Attention 40 ⭐
Our paper was published in the proceedings of ACM Multimedia 2017 (MM' 17) .
Attention Sentiment 40 ⭐
My bachelor's degree thesis (with code and experiments) on sentiment classification of Russian texts using Bi-RNN with attention mechanism.
Attentional Pointnet 43 ⭐
Attentional-PointNet is Deep-Neural-Network architecture for 3D object detection in point clouds
Sturcture Inpainting 45 ⭐
Source code of AAAI 2020 paper 'Learning to Incorporate Structure Knowledge for Image Inpainting'
Attentional Neural Factorization Machine 39 ⭐
Attention,Factorization Machine, Deep Learning, Recommender System
Eqtransformer 48 ⭐
EQTransformer, a python package for earthquake signal detection and phase picking using AI.
Anmm Cikm16 37 ⭐
Implementation of Attention-Based Neural Matching Model Proposed in CIKM16 for Answer Sentence Selection
Quantumforest 36 ⭐
Fast Differentiable Forest lib with the advantages of both decision trees and neural networks
Aat 33 ⭐
Code for paper "Adaptively Aligned Image Captioning via Adaptive Attention Time". NeurIPS 2019
Hierarchical Word Sense Disambiguation Using Wordnet Senses 33 ⭐
Word Sense Disambiguation using Word Specific models, All word models and Hierarchical models in Tensorflow
Vista Net 34 ⭐
Implementation of the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis"
Automatic Personality Prediction 31 ⭐
[AAAI 2020] Modeling Personality with Attentive Networks and Contextual Embeddings
Audio Vision 29 ⭐
Implementation and reviews of Audio & Computer vision related papers in python using keras and tensorflow.
Pytorch_neural_machine_translation_attention 30 ⭐
Neural Machine Translation with Attention (PyTorch)
Txt2txt 29 ⭐
Extremely easy to use sequence to sequence library with attention, for text to text conversion tasks.
Dongjun Lee Rnn Text Classification Tf 26 ⭐
Tensorflow implementation of Attention-based Bidirectional RNN text classification.
3han 26 ⭐
3HAN: A Deep Neural Network for Fake News Detection: https://link.springer.com/chapter/10.1007%2F978-3-319-70096-0_59
Languagemodel Using Attention 25 ⭐
Pytorch implementation of a basic language model using Attention in LSTM network
Attentiongatedvnet3D 26 ⭐
Attention Gated VNet3D Model for KiTS19——2019 Kidney Tumor Segmentation Challenge
Neural Networks For Time Series Analysis 23 ⭐
Compare how ANNs, RNNs, LSTMs, and LSTMs with attention perform on time-series analysis
Keras_attentivenormalization 30 ⭐
Unofficial Keras implementation of the paper Attentive Normalization.
3D Object Reconstruction From Multi View Monocular Rgb Images 24 ⭐
Hybrid Ensemble Approach For 3D Object Reconstruction from Multi-View Monocular RGB images
Medical Diagnosis Learning 23 ⭐
Learning from Discharge Summaries to extract mentioned diagnoses using Hierarchical Attention Model
Psiphitheta Lstm Attention 22 ⭐
A Comparison of LSTMs and Attention Mechanisms for Forecasting Financial Time Series
Global And Local Attention Based Free Form Image Inpainting 26 ⭐
Official implementation of "Global and local attention-based free-form image inpainting"
Layer_augmentation 24 ⭐
Implementation of the NLI model in our ACL 2019 paper: Augmenting Neural Networks with First-order Logic.
Compact Global Descriptor 21 ⭐
Pytorch implementation of "Compact Global Descriptor for Neural Networks" (CGD).
Ruixuejianfei Scan 21 ⭐
Code for Self-and-Collaborative Attention Network from "SCAN: Self-and-Collaborative Attention Network for Video Person Re-identification" TIP2019
Garnn 22 ⭐
TensorFlow implementation of Graphical Attention Recurrent Neural Networks based on work by Cirstea et al., 2019.
Ag Cnn 21 ⭐
This is a reimplementation of AG-CNN. ("Thorax Disease Classification with Attention Guided Convolutional Neural Network","Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification")
Datastories Semeval2017 Task6 19 ⭐
Deep-learning model presented in "DataStories at SemEval-2017 Task 6: Siamese LSTM with Attention for Humorous Text Comparison".
Linear Multihead Attention 19 ⭐
Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
Hierarchical Attention Network 20 ⭐
My implementation of "Hierarchical Attention Networks for Document Classification" in Keras
Multi Task Conditional Attention Networks 20 ⭐
A prototype version of our submitted paper: Conversion Prediction Using Multi-task Conditional Attention Networks to Support the Creation of Effective Ad Creatives.
Unsupervisedattentionmechanism 18 ⭐
Code for our paper: "Constraining Implicit Space with Minimum Description Length: An Unsupervised Attention Mechanism across Neural Network Layers".
Attn Gan 18 ⭐
Pytorch implementation of paper: AttnGAN Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Cian 18 ⭐
Implementation of the Character-level Intra Attention Network (CIAN) for Natural Language Inference (NLI) upon SNLI and MultiNLI corpus
Extkeras 18 ⭐
Playground for implementing custom layers and other components compatible with keras, with the purpose to learn the framework better and perhaps in future offer some utils for others.
Domain Attention 20 ⭐
codes for paper "Domain Attention Model for Multi-Domain Sentiment Classification"
Leviborodenko Dgcnn 19 ⭐
Clean & Documented TF2 implementation of "An end-to-end deep learning architecture for graph classification" (M. Zhang et al., 2018).
Compressive Transformer Pytorch 31 ⭐
Pytorch implementation of Compressive Transformers, from Deepmind
Machine Translation Hindi To English 17 ⭐
Machine translation is the task of converting one language to other. Unlike the traditional phrase-based translation system which consists of many small sub-components that are tuned separately, neural machine translation attempts to build and train a single, large neural network that reads a sentence and outputs a correct translation.
Cvdd Pytorch 18 ⭐
A PyTorch implementation of Context Vector Data Description (CVDD), a method for Anomaly Detection on text.
Dfnet 17 ⭐
Keras implementation of "DFNet: Discriminative feature extraction and integration network for salient object detection"
Ala 17 ⭐
Attention-based LSTM model with the Aspect information to solve financial opinion mining problem (WWW 2018 shared task1)
Focus Longer To See Better 25 ⭐
[CVPRW 2020] Focus Longer to See Better:Recursively Refined Attention for Fine-Grained Image Classification
Axial Attention 37 ⭐
Implementation of Axial attention - attending to multi-dimensional data efficiently
Natural Language Processing Nanodegree 15 ⭐
Natural Language Processing Nanodegree from Udacity Platform, in which I implement Hidden Markov Model for POS Tagger, Bidirectional LSTM for English-French Machine Translation, and End-to-End LSTM-based Speech Recognition
Keras_attention_seq2seq 15 ⭐
A sequence-to-sequence framework of Keras-based generative attention mechanisms that humans can read.一个人类可以阅读的基于Keras的代注意力机制的序列到序列的框架/模型，或许你不用写复杂的代码，直接使用吧。
Idne 15 ⭐
Python package for the paper "Inductive Document Network Embedding with Topic-Word Attention" (https://arxiv.org/pdf/2001.03369.pdf)
Fake News Detection Liar Pytorch 16 ⭐
Fake News Detection by Learning Convolution Filters through Contextualized Attention
Suragnair Im2latex 15 ⭐
An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem
Organic Chemistry Reaction Prediction Using Nmt 14 ⭐
organic chemistry reaction prediction using NMT with Attention
Sequence Models 15 ⭐
Programming assignments of "Sequence Models" course of deep learning specialization by Andrew Ng in Coursera
S2vt Seq2seq Video Captioning Attention 14 ⭐
S2VT (seq2seq) video captioning with bahdanau & luong attention implementation in Tensorflow
Pointer_generator_summarizer 13 ⭐
Pointer Generator Network: Seq2Seq with attention, pointing and coverage mechanism for abstractive summarization.
Nmt With Attention Mechanism 14 ⭐
In this project I implement Neural Machine Translation using Attention mechanism. The code is written using the TensorFlow library in Python. I have used TensorFlow functionalities like tf.data.Dataset to manage the input pipeline, Eager Execution and Model sub classing to create the model architecture.
Karma9874 Seq2seq Chatbot 13 ⭐
Chatbot based Seq2Seq model with bidirectional rnn and attention mechanism with tensorflow, trained on Cornell Movie-Dialogs Corpus and deployed on a Flask Server
Ts3000_thechatbot 12 ⭐
Its a social networking chat-bot trained on Reddit dataset . It supports open bounded queries developed on the concept of Neural Machine Translation. Beware of its being sarcastic just like its creator :stuck_out_tongue_closed_eyes: BDW it uses Pytorch framework and Python3.
Danet 13 ⭐
A PyTorch implementation of DANet based on CVPR 2019 paper "Dual Attention Network for Scene Segmentation"
Rsanet 12 ⭐
RSANet: Recurrent Slice-wise Attention Network for Multiple Sclerosis Lesion Segmentation (MICCAI 2019)
Retinal Disease Diagnosis With Residual Attention Networks 11 ⭐
Using Residual Attention Networks to diagnose retinal diseases in medical images
Hierarchical Multi Label Text Classification 100 ⭐
The code of CIKM'19 paper《Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach》
Zhaohengyuan1 Pan 68 ⭐
[Params: Only 272K!!!] Efficient Image Super-Resolution Using Pixel Attention, in ECCV Workshop, 2020.
Dual_stage_attention_rnn 10 ⭐
A Tensorflow Implementation of Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
Memory Transformer Xl 10 ⭐
A variant of Transformer-XL where the memory is updated not with a queue, but with attention
bad-slug 658 ⭐
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
bad-slug 71 ⭐
Official PyTorch Implementation for "Rotate to Attend: Convolutional Triplet Attention Module."
bad-slug 54 ⭐
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
bad-slug 23 ⭐
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks