42 Open Source Attention Is All You Need Software Projects
Free and open source attention is all you need code projects including engines, APIs, generators, and tools.
Attention Is All You Need Pytorch 6195 ⭐
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Kyubyong Transformer 3673 ⭐
A TensorFlow Implementation of the Transformer: Attention Is All You Need
Sockeye 1044 ⭐
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Bert_language_understanding 949 ⭐
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Attention Is All You Need Keras 653 ⭐
A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
Speech Transformer 646 ⭐
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Jayparks Transformer 378 ⭐
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
Linear Attention Recurrent Neural Network 126 ⭐
A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
Kospeech 342 ⭐
Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.
Transformers_without_tears 98 ⭐
Transformers without Tears: Improving the Normalization of Self-Attention
Phohenecker Pytorch Transformer 42 ⭐
A PyTorch implementation of the Transformer model from "Attention Is All You Need".
Zimmerrol Attention Is All You Need Keras 30 ⭐
Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
Fake News Detection Liar Pytorch 24 ⭐
Fake News Detection by Learning Convolution Filters through Contextualized Attention
A Pytorch Tutorial To Machine Translation 54 ⭐
Attention Is All You Need | a PyTorch Tutorial to Machine Translation
Flrngel Transformer Tensorflow 10 ⭐
Yet another tensorflow implementation of "Attention is all you need" (a.k.a. Transformer)
Pytorch Original Transformer 546 ⭐
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Sooftware Speech Transformer 29 ⭐
Transformer framework speciaized in speech recognition tasks using Pytorch.
Zabanshenas 11 ⭐
Zabanshenas is a solution for identifying the most likely language of a piece of written text. Demo (👇 )