213 Open Source Attention Software Projects
Free and open source attention code projects including engines, APIs, generators, and tools.
Attention Is All You Need Pytorch 4394 ⭐
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Pytorch Seq2seq 2130 ⭐
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
Nlp Models Tensorflow 1406 ⭐
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
Nlp Journey 1207 ⭐
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
Tf Rnn Attention 720 ⭐
Tensorflow implementation of attention mechanism for text classification tasks.
Jtkim Kaist Vad 578 ⭐
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
Speech Transformer 489 ⭐
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Rnn Nlu 459 ⭐
A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling
Mac Network 424 ⭐
Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)
Punctuator2 431 ⭐
A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text
Deep_learning_nlp 384 ⭐
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
Text Classification Models Pytorch 353 ⭐
Implementation of State-of-the-art Text Classification Models in Pytorch
Attentionwalk 256 ⭐
A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).
Abd Net 248 ⭐
[ICCV 2019] "ABD-Net: Attentive but Diverse Person Re-Identification" https://arxiv.org/abs/1908.01114
Astgcn 233 ⭐
⚠️[Deprecated] no longer maintained, please use the code in https://github.com/guoshnBJTU/ASTGCN-r-pytorch
Appnp 212 ⭐
A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).
Neat Vision 199 ⭐
Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)
Self Attentive Tensorflow 190 ⭐
Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"
Guided Attention Inference Network 190 ⭐
Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.
Yolov4 Pytorch 594 ⭐
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
Nlp Tutorials 209 ⭐
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
Datastories Semeval2017 Task4 179 ⭐
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Pyramid Attention Networks Pytorch 175 ⭐
Implementation of Pyramid Attention Networks for Semantic Segmentation.
Dsksd Rnn For Joint Nlu 169 ⭐
Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (https://arxiv.org/abs/1609.01454)
Attentionn 163 ⭐
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
Graph_attention_pool 159 ⭐
Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)
Hey Jetson 147 ⭐
Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Soujanyaporia Multimodal Sentiment Analysis 143 ⭐
Attention-based multimodal fusion for sentiment analysis
Multihead Siamese Nets 132 ⭐
Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.
Sightseq 112 ⭐
Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection
Captcharecognition 96 ⭐
End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别
Self Attentive Emb Tf 95 ⭐
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
Njunmt Tf 94 ⭐
An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.
Image Caption Generator 100 ⭐
A neural network to generate captions for an image using CNN and RNN with BEAM Search.
Eval On Nn Of Rc 85 ⭐
Empirical Evaluation on Current Neural Networks on Cloze-style Reading Comprehension
Deeplearningreading 78 ⭐
Deep Learning and Machine Learning mini-projects. Current Project: Deepmind Attentive Reader (rc-data)
Ccnet Pure Pytorch 89 ⭐
Criss-Cross Attention for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.
Mgcam 75 ⭐
Mask data and code for 'Mask-guided Contrastive Attention Model for Person Re-Identification' (CVPR-2018)
Slqa 71 ⭐
An Unofficial Pytorch Implementation of Multi-Granularity Hierarchical Attention Fusion Networks for Reading Comprehension and Question Answering
Dreyeve 68 ⭐
[TPAMI 2018] Predicting the Driver’s Focus of Attention: the DR(eye)VE Project. A deep neural network learnt to reproduce the human driver focus of attention (FoA) in a variety of real-world driving scenarios.
Hatn 68 ⭐
Hierarchical Attention Transfer Network for Cross-domain Sentiment Classification (AAAI'18)
Prime 65 ⭐
A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
Ntua Slp Semeval2018 64 ⭐
Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.
Pop Music Highlighter 60 ⭐
"Pop Music Highlighter: Marking the Emotion Keypoints", TISMIR vol. 1, no. 1
Attention Over Attention Tf Qa 58 ⭐
论文“Attention-over-Attention Neural Networks for Reading Comprehension”中AoA模型实现
Jeelizglancetracker 57 ⭐
Recurrent Independent Mechanisms 57 ⭐
Implementation of the paper Recurrent Independent Mechanisms (https://arxiv.org/pdf/1909.10893.pdf)
Keras Utility Layer Collection 56 ⭐
Collection of custom layers and utility functions for Keras which are missing in the main framework.
Semantic Aware Attention Based Deep Object Co Segmentation 52 ⭐
Semantic Aware Attention Based Deep Object Co-segmentation
Xiaox 51 ⭐
flask+seq2seq【TensorFlow1.0, Pytorch】 :art: :art: 在线聊天机器人 https://mp.weixin.qq.com/s/VpiAmVSTin3ALA8MnzhCJA 或 https://ask.hellobi.com/blog/python_shequ/14486
Deepmove 53 ⭐
Codes for WWW'18 Paper-DeepMove: Predicting Human Mobility with Attentional Recurrent Network
Sentences_pair_similarity_calculation_siamese_lstm 46 ⭐
A Keras Implementation of Attention_based Siamese Manhattan LSTM
Pytorch Pyramid Feature Attention Network For Saliency Detection 60 ⭐
PyTorch implementation of the CVPR 2019 paper “Pyramid Feature Attention Network for Saliency Detection”
Biblosa Pytorch 43 ⭐
Re-implementation of Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling (T. Shen et al., ICLR 2018) on Pytorch.
Gazepointheatmap 45 ⭐
Easy to use Python command line based tool to generate a gaze point heatmap from a csv file. 👁️
Tensorflow Chatbot Chinese 42 ⭐
網頁聊天機器人 | tensorflow implementation of seq2seq model with bahdanau attention and Word2Vec pretrained embedding
Time Attention 43 ⭐
Implementation of RNN for Time Series prediction from the paper https://arxiv.org/abs/1704.02971
Attentionmask 41 ⭐
AttentionMask: Attentive, Efficient Object Proposal Generation Focusing on Small Objects (ACCV 2018, accepted as oral)
Visual Question Answering 38 ⭐
CNN+LSTM, Attention based, and MUTAN-based models for Visual Question Answering
Mgan 37 ⭐
Exploiting Coarse-to-Fine Task Transfer for Aspect-level Sentiment Classification (AAAI'19)
Hierarchical Word Sense Disambiguation Using Wordnet Senses 33 ⭐
Word Sense Disambiguation using Word Specific models, All word models and Hierarchical models in Tensorflow
Sequence To Sequence And Attention From Scratch Using Tensorflow 29 ⭐
Sequence to Sequence and attention from scratch using Tensorflow
Automatic Personality Prediction 31 ⭐
[AAAI 2020] Modeling Personality with Attentive Networks and Contextual Embeddings
Imdb Rnn Attention 29 ⭐
Bidirectional GRU with attention mechanism on imdb sentimental analysis dataset
Txt2txt 29 ⭐
Extremely easy to use sequence to sequence library with attention, for text to text conversion tasks.
Nmt Attention Tf2 30 ⭐
👫 Effective Approaches to Attention-based Neural Machine Translation implemented as Tensorflow 2.0
Defactonlp 25 ⭐
DeFactoNLP: An Automated Fact-checking System that uses Named Entity Recognition, TF-IDF vector comparison and Decomposable Attention models.
Attentive Neural Processes 25 ⭐
implementing "recurrent attentive neural processes" to forecast power usage (w. LSTM baseline, MCDropout)
Nlp_tensorflow_project 24 ⭐
Use tensorflow to achieve some NLP project, eg: classification chatbot ner attention QAetc.
Keras Seq2seq Chatbot With Attention 25 ⭐
It is a seq2seq encoder decoder chatbot using keras and with attention
Layer_augmentation 24 ⭐
Implementation of the NLI model in our ACL 2019 paper: Augmenting Neural Networks with First-order Logic.
Ximingxing Chatbot 24 ⭐
一个基于深度学习的中文聊天机器人，这里有详细的教程与代码，每份代码都有详细的注释，作为学习是美好的选择。A Chinese chatbot based on deep learning.
Base On Relation Method Extract News Da Rnn Model For Stock Prediction Pytorch 22 ⭐
Arianhosseini Question Answering 20 ⭐
Exploration of various deep neural networks for Question Answering and Reading Comprehension
Garnn 22 ⭐
TensorFlow implementation of Graphical Attention Recurrent Neural Networks based on work by Cirstea et al., 2019.
Datastories Semeval2017 Task6 19 ⭐
Deep-learning model presented in "DataStories at SemEval-2017 Task 6: Siamese LSTM with Attention for Humorous Text Comparison".
Tensorflow Seq2seq 19 ⭐
Implement en-fr translation task by implenting seq2seq, encoder-decoder in RNN layers with Attention mechanism and Beamsearch inference decoder in TensorFlow 1.3
Structured Self Attentive Sentence Embedding 18 ⭐
Re-Implementation of "A Structured Self-Attentive Sentence Embedding" by Lin et al., 2017
Unsupervisedattentionmechanism 18 ⭐
Code for our paper: "Constraining Implicit Space with Minimum Description Length: An Unsupervised Attention Mechanism across Neural Network Layers".
Longxingtan Text Classification 15 ⭐
A collection of text classification algorithms in tensorflow: cnn, rnn, attention, bert, capsule, clstm, rcnn
Interpretable Han For Document Classification With Keras 16 ⭐
Keras implementation of hierarchical attention network for document classification with options to predict and present attention weights on both word and sentence level.
Att_gconvs 18 ⭐
Code repository for the paper "Attentive Group Equivariant Convolutional Neural Networks" published at ICML 2020. https://arxiv.org/abs/2002.03830
Ai_challenger_2018_sentiment_analysis 15 ⭐
Fine-grained Sentiment Analysis of User Reviews --- AI CHALLENGER 2018
Donghyeonk Match Lstm 14 ⭐
PyTorch Implementation of "Learning Natural Language Inference with LSTM", 2016, S. Wang et al. (https://arxiv.org/pdf/1512.08849.pdf)
Suragnair Im2latex 15 ⭐
An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem
Pytorch Attention Augmented Convolution 14 ⭐
A pytorch implementation of https://arxiv.org/abs/1904.09925
Translation Model 13 ⭐
French-English translator using word embeddings, bi-directional encoder, and decoder with attention
Attention Dialog Embedding 13 ⭐
Attention based dialog embedding for dialog breakdown detection (in DSTC6 task 3)
Bert Attribute Value Extract 15 ⭐
A Pytorch implementation of "Scaling Up Open Tagging from Tens to Thousands: Comprehension Empowered Attribute Value Extraction from Product Title" (ACL 2019).
Veritasauthorship Veritas 12 ⭐
Attention-based Recurrent Neural Nets + POS embeddings for Authorship Recognition
Rsanet 12 ⭐
RSANet: Recurrent Slice-wise Attention Network for Multiple Sclerosis Lesion Segmentation (MICCAI 2019)
Perceive Transform And Act 13 ⭐
PyTorch code for the paper: "Perceive, Transform, and Act: Multi-Modal Attention Networks for Vision-and-Language Navigation"
Keras Attn_aug_cnn 13 ⭐
Extension of the `Attention Augmented Convolutional Networks` paper for 1-D convolution operation.
Attention Is All You Need 12 ⭐
A PyTorch Implementation of Transformer in "Attention Is All You Need"
Simpthon Pytorch Seq2seq 14 ⭐
An Implementation of Encoder-Decoder model with global attention mechanism.
Research Experiments 10 ⭐
Includes implementations of various Question-Answering models for the SQuAD dataset and other Research Experiments
Gaurav104 Textclassification 10 ⭐
Repository of state of the art text/documentation classification algorithms in Pytorch.
Yanbeic Val 22 ⭐
Code on Paper [CVPR20]Image Search with Text Feedback by Visiolinguistic Attention Learning
Fastpunct 61 ⭐
Fast and accurate punctuation restoration on unsegmented text using sequence to sequence model consisting of bidirectional recurrent neural network model ( LSTM ) and attention mechanism.
Attention Se.pytorch 13 ⭐
An Attention-based Neural Network Approach for Single Channel Speech Enhancement
Vqa_regat 102 ⭐
Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
Prajjwal1 Fluence 29 ⭐
A deep learning library based on Pytorch focussed on low resource language research and robustness
bad-slug 54 ⭐
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
bad-slug 23 ⭐
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
bad-slug 11 ⭐
Traffic prediction is the task of predicting future traffic measurements (e.g. volume, speed, etc.) in a road network (graph), using historical data (timeseries).