277 Open Source Language Model Software Projects
Free and open source language model code projects including engines, APIs, generators, and tools.
📝 Wrapper library for text generation / language models at char and word level with RNN in TensorFlow
Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.
结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、PCA、SVD
Connectionist Temporal Classification (CTC) decoder with dictionary and language model.
AutoenCODE is a Deep Learning infrastructure that allows to encode source code fragments into vector representations, which can be used to learn similarities.
A Pytorch Tutorial To Sequence Labeling298 ⭐
Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling
Pytorch Openai Transformer Lm1337 ⭐
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
Relational Rnn Pytorch239 ⭐
An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.
Keras Bert2281 ⭐
Implementation of BERT that could load official pre-trained models for feature extraction and prediction
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Huggingface Transformers57412 ⭐
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
Bert As Language Model213 ⭐
BERT as language model, fork from https://github.com/google-research/bert
Azureml Bert357 ⭐
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
Awesome Bert Nlp656 ⭐
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
Protein Sequence Embedding Iclr2019213 ⭐
Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019
Wae Rnf Lm56 ⭐
Pytorch Implemetation for our NAACL2019 Paper "Riemannian Normalizing Flow on Variational Wasserstein Autoencoder for Text Modeling" https://arxiv.org/abs/1904.02399
Attention Mechanisms261 ⭐
Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.
Pretraining For Language Understanding73 ⭐
Pre-training of Language Models for Language Understanding
A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
Deepset Ai Haystack3855 ⭐
:mag: Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.
Cluebenchmark Clue2495 ⭐
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Artificial Self Amld 202068 ⭐
Workshop material for the AMLD 2020 workshop on "Meet your Artificial Self: Generate text that sounds like you"
Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"
Pytorch library for end-to-end transformer models training, inference and serving
Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.
Char Rnn Chinese192 ⭐
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.
Rnn Theano69 ⭐
RNN(LSTM, GRU) in Theano with mini-batch training; character-level language models in Theano
Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.
Chewxy Lingo121 ⭐
package lingo provides the data structures and algorithms required for natural language processing
Awesome Speech Recognition Speech Synthesis Papers2137 ⭐
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)