A PyTorch implementation of the Transformer model in "Attention is All You Need".
-
Updated
Apr 16, 2024 - Python
#
attention-is-all-you-need
Here are 221 public repositories matching this topic...
A TensorFlow Implementation of the Transformer: Attention Is All You Need
-
Updated
May 21, 2023 - Python
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
python machine-learning deep-learning speech transformers python3 pytorch speech-recognition speech-to-text attention-mechanism whisper speech-processing asr speaker-diarization attention-model attention-is-all-you-need attention-seq2seq attention-visualization attention-network multilingual-models
-
Updated
Dec 6, 2024 - Python
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
machine-learning deep-neural-networks translation deep-learning machine-translation pytorch transformer seq2seq neural-machine-translation sequence-to-sequence attention-mechanism encoder-decoder attention-model sequence-to-sequence-models attention-is-all-you-need sockeye transformer-architecture transformer-network
-
Updated
Oct 24, 2024 - Python
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
python deep-learning jupyter transformers pytorch transformer attention deeplearning attention-mechanism attention-is-all-you-need pytorch-transformers pytorch-transformer transformer-tutorial original-transformer
-
Updated
Dec 27, 2020 - Jupyter Notebook
list of efficient attention modules
awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer
-
Updated
Aug 23, 2021 - Python
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding
-
Updated
Jan 1, 2019 - Python
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
-
Updated
Apr 6, 2023 - Python
A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
-
Updated
Sep 24, 2021 - Python
Attention is all you need implementation
-
Updated
Jun 8, 2024 - Jupyter Notebook
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
machine-learning artificial-intelligence transformer attention attention-is-all-you-need attention-mechanisms gpt3 gpt4 chatgpt context-length
-
Updated
Jan 7, 2024 - Python
Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.
end-to-end pytorch transformer speech-recognition las seq2seq jasper asr conformer attention-is-all-you-need korean-speech e2e-asr las-models ksponspeech
-
Updated
May 27, 2023 - Python
A Benchmark of Text Classification in PyTorch
benchmark text-classification quantum cnn pytorch lstm rcnn attention-is-all-you-need crnn cnn-classification lstm-sentiment-analysis capusle
-
Updated
Apr 20, 2024 - Python
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
-
Updated
Oct 1, 2020 - Python
Neural Machine Translation with Keras
machine-learning theano deep-learning tensorflow machine-translation keras transformer gru neural-machine-translation sequence-to-sequence nmt attention-mechanism web-demo attention-model lstm-networks attention-is-all-you-need attention-seq2seq
-
Updated
Jul 30, 2021 - Python
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
-
Updated
Dec 17, 2024 - Python
An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images
attention multimodality attention-is-all-you-need multimodal-learning multimodal imagegeneration dalle
-
Updated
Dec 15, 2023 - Python
Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"
machine-learning ai tensorflow ml pytorch artificial-intelligence attention attention-is-all-you-need gpt-4
-
Updated
Nov 11, 2024 - Python
[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"
-
Updated
May 28, 2024 - Python
Attention Is All You Need | a PyTorch Tutorial to Transformers
pytorch transformer pytorch-tutorial attention-is-all-you-need transformer-architecture transformer-tutorial
-
Updated
Feb 22, 2024 - Python
Improve this page
Add a description, image, and links to the attention-is-all-you-need topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the attention-is-all-you-need topic, visit your repo's landing page and select "manage topics."