35 Open Source Attention Is All You Need Software Projects
Free and open source attention is all you need code projects including engines, APIs, generators, and tools.
Attention Is All You Need Pytorch 4394 ⭐
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Kyubyong Transformer 3222 ⭐
A TensorFlow Implementation of the Transformer: Attention Is All You Need
Sockeye 972 ⭐
Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet
Bert_language_understanding 919 ⭐
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Attention Is All You Need Keras 610 ⭐
A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
Speech Transformer 489 ⭐
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Jayparks Transformer 193 ⭐
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
Linear Attention Recurrent Neural Network 115 ⭐
A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
Transformers_without_tears 62 ⭐
Transformers without Tears: Improving the Normalization of Self-Attention
Phohenecker Pytorch Transformer 42 ⭐
A PyTorch implementation of the Transformer model from "Attention Is All You Need".
Zimmerrol Attention Is All You Need Keras 25 ⭐
Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
Fake News Detection Liar Pytorch 16 ⭐
Fake News Detection by Learning Convolution Filters through Contextualized Attention
A Pytorch Tutorial To Machine Translation 17 ⭐
Attention Is All You Need | a PyTorch Tutorial to Machine Translation
Attention Is All You Need 12 ⭐
A PyTorch Implementation of Transformer in "Attention Is All You Need"
Flrngel Transformer Tensorflow 10 ⭐
Yet another tensorflow implementation of "Attention is all you need" (a.k.a. Transformer)