← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Analyzing Breath Signals for the Interspeech 2020 ComParE Challenge INTERSPEECH 2020
Multi-Unit Transformers for Neural Machine Translation EMNLP 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020
Cascaded Semantic and Positional Self-Attention Network for Document Classification EMNLP 2020
Document Ranking with a Pretrained Sequence-to-Sequence Model EMNLP 2020
Scene Graph Modification Based on Natural Language Commands EMNLP 2020
Transition-based Parsing with Stack-Transformers EMNLP 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages EMNLP 2020
Hierarchical Pre-training for Sequence Labelling in Spoken Dialog EMNLP 2020
Large Product Key Memory for Pretrained Language Models EMNLP 2020
Deep Transformers with Latent Depth NIPS 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing NIPS 2020
NUIG: Multitasking Self-attention based approach to SigTyp 2020 Shared Task EMNLP 2020
The University of Edinburgh’s English-Tamil and English-Inuktitut Submissions to the WMT20 News Translation Task EMNLP 2020
Transformer-based Neural Machine Translation System for Hindi – Marathi: WMT20 Shared Task EMNLP 2020
Efficient Context-Aware Neural Machine Translation with Layer-Wise Weighting and Input-Aware Gating IJCAI 2020
Conformer: Convolution-augmented Transformer for Speech Recognition INTERSPEECH 2020
PolyGen: An Autoregressive Generative Model of 3D Meshes ICML 2020
Neural Machine Translation for Similar Languages: The Case of Indo-Aryan Languages EMNLP 2020
Tencent AI Lab Machine Translation Systems for the WMT20 Biomedical Translation Task EMNLP 2020
Big Bird: Transformers for Longer Sequences NIPS 2020
Text Segmentation by Cross Segment Attention EMNLP 2020
Unsupervised Evaluation for Question Answering with Transformers EMNLP 2020
Low-Rank Bottleneck in Multi-head Attention Models ICML 2020
Towards Reasonably-Sized Character-Level Transformer NMT by Finetuning Subword Systems EMNLP 2020